18052827. METHOD AND SYSTEM FOR VIDEO TRANSFORMATION FOR VIDEO SEE-THROUGH AUGMENTED REALITY simplified abstract (SAMSUNG ELECTRONICS CO., LTD.)
METHOD AND SYSTEM FOR VIDEO TRANSFORMATION FOR VIDEO SEE-THROUGH AUGMENTED REALITY
Organization Name
Inventor(s)
Yingen Xiong of Mountain View CA (US)
Christopher A. Peri of Mountain View CA (US)
METHOD AND SYSTEM FOR VIDEO TRANSFORMATION FOR VIDEO SEE-THROUGH AUGMENTED REALITY - A simplified explanation of the abstract
This abstract first appeared for US patent application 18052827 titled 'METHOD AND SYSTEM FOR VIDEO TRANSFORMATION FOR VIDEO SEE-THROUGH AUGMENTED REALITY
Simplified Explanation
The abstract describes a method for video transformation in an augmented reality device. Here are the key points:
- The method involves obtaining video frames from multiple cameras in the augmented reality device.
- Each video frame is associated with position data, allowing for accurate rendering.
- Camera viewpoint depth maps are generated based on the video frames and position data.
- Depth re-projection is performed to transform the video frames from camera viewpoints to rendering viewpoints using the depth maps.
- Hole filling is done to fill any gaps or holes created during the transformation process.
- The transformed video frames, including the hole-filled frames, are displayed on multiple displays associated with the augmented reality device.
Potential applications of this technology:
- Augmented reality gaming: The method can enhance the gaming experience by seamlessly integrating virtual objects into the real-world environment.
- Industrial training: The technology can be used to provide realistic simulations and training scenarios in fields such as manufacturing, construction, and medicine.
- Navigation and wayfinding: The method can overlay navigation information, such as directions or points of interest, onto the real-world view, aiding users in finding their way.
Problems solved by this technology:
- Accurate rendering: By using position data and depth maps, the method ensures that virtual objects are properly aligned and integrated with the real-world environment.
- Occlusion handling: The hole filling process addresses occlusion areas, ensuring that virtual objects are not obstructed by real-world objects.
- Seamless transformation: The depth re-projection transforms the video frames smoothly, providing a seamless augmented reality experience.
Benefits of this technology:
- Enhanced user experience: The method improves the realism and accuracy of augmented reality content, leading to a more immersive and engaging user experience.
- Improved object integration: By accurately aligning virtual objects with the real-world environment, the method creates a more seamless integration of augmented reality content.
- Versatile applications: The technology can be applied in various fields, including gaming, training, navigation, and more, offering a wide range of possibilities for augmented reality experiences.
Original Abstract Submitted
A method of video transformation for a video see-through (VST) augmented reality (AR) device includes obtaining video frames from multiple cameras associated with the VST AR device, where each video frame is associated with position data. The method also includes generating camera viewpoint depth maps associated with the video frames based on the video frames and the position data. The method further includes performing depth re-projection to transform the video frames from camera viewpoints to rendering viewpoints using the camera viewpoint depth maps. The method also includes performing hole filling of one or more holes created in one or more occlusion areas of at least one of the transformed video frames during the depth re-projection to generate at least one hole-filled video frame. In addition, the method includes displaying the transformed video frames including the at least one hole-filled video frame on multiple displays associated with the VST AR device.
