Samsung Electronics Co., Ltd. (20240257475). GENERATION AND RENDERING OF EXTENDED-VIEW GEOMETRIES IN VIDEO SEE-THROUGH (VST) AUGMENTED REALITY (AR) SYSTEMS simplified abstract
GENERATION AND RENDERING OF EXTENDED-VIEW GEOMETRIES IN VIDEO SEE-THROUGH (VST) AUGMENTED REALITY (AR) SYSTEMS
Organization Name
Inventor(s)
Yingen Xiong of Mountain View CA (US)
GENERATION AND RENDERING OF EXTENDED-VIEW GEOMETRIES IN VIDEO SEE-THROUGH (VST) AUGMENTED REALITY (AR) SYSTEMS - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240257475 titled 'GENERATION AND RENDERING OF EXTENDED-VIEW GEOMETRIES IN VIDEO SEE-THROUGH (VST) AUGMENTED REALITY (AR) SYSTEMS
The method described in the patent application involves capturing multiple see-through image frames of an environment using imaging sensors on an augmented reality device. These frames are used to generate a depth map and a three-dimensional representation of the environment. The 3D representation is then projected onto a curved surface, mapped to virtual view images, and displayed on the AR device.
- Obtaining multiple see-through image frames of an environment using imaging sensors on an AR device
- Generating a depth map and a 3D representation of the environment based on the image frames
- Projecting the 3D representation onto a curved surface
- Mapping points of the 3D representation to virtual view images
- Presenting the virtual view images on displays of the AR device
Potential Applications: - Augmented reality gaming - Navigation and wayfinding applications - Virtual tours and experiences - Training and simulation programs - Medical imaging and visualization
Problems Solved: - Enhancing the immersive experience of augmented reality - Improving the accuracy and realism of virtual representations - Providing a more interactive and engaging user interface
Benefits: - Enhanced user experience in AR applications - More realistic and detailed virtual environments - Improved spatial understanding and interaction in AR scenarios
Commercial Applications: Title: "Enhanced Augmented Reality Visualization Technology" This technology could be used in various industries such as gaming, education, healthcare, and design to create more engaging and interactive AR experiences. It could also be integrated into AR glasses and headsets for consumer and enterprise applications.
Questions about the technology: 1. How does this technology improve the accuracy of depth mapping in augmented reality environments? 2. What are the potential limitations of projecting 3D representations onto curved surfaces in AR devices?
Original Abstract Submitted
a method includes obtaining multiple see-through image frames of an environment around an augmented reality (ar) device using multiple imaging sensors of the ar device. the method also includes generating a depth map based on the see-through image frames and generating a three-dimensional (3d) representation of the environment based on the depth map. the method further includes projecting the 3d representation onto a curved surface, mapping points of the projected 3d representation to multiple virtual view images, and presenting the virtual view images on one or more displays of the ar device. generating the depth map may include generating an initial depth map using a trained machine learning model and modifying the initial depth map to provide both spatial consistency and temporal consistency in order to generate a refined depth map. the curved surface may include a portion of a cylindrical, spherical, or conical surface.
