Meta platforms technologies, llc (20240119672). SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY simplified abstract

SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY

Organization Name

meta platforms technologies, llc

Inventor(s)

Gaurav Chaurasia of Meilen (CH)

[[:Category:Jan Oberl�nder of Binningen (CH)|Jan Oberl�nder of Binningen (CH)]][[Category:Jan Oberl�nder of Binningen (CH)]]

Ricardo da Silveira Cabral of Zurich (CH)

Paul Timothy Furgale of Thalwil (CH)

SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240119672 titled 'SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY

Simplified Explanation

The patent application describes a method for generating stereoscopic colorized images for display to a user using a color camera and two monochrome cameras associated with the user's eyes.

• Computing a point cloud of the visible environment based on stereoscopic grayscale images captured by the monochrome cameras
• Generating a mesh of the visible environment based on the computed point cloud
• Generating two stereoscopic colorized images for each eye of the user using the mesh, luminance information from the corresponding grayscale image, and color information from a color input image captured by the color camera

Potential Applications

This technology could be applied in virtual reality systems, augmented reality devices, and 3D imaging applications.

Problems Solved

This technology solves the problem of generating realistic and immersive stereoscopic images for users by combining grayscale and color information from multiple cameras.

Benefits

The benefits of this technology include enhanced visual experiences, improved depth perception, and more realistic virtual environments.

Potential Commercial Applications

Commercial applications of this technology could include VR gaming, medical imaging, architectural visualization, and entertainment industries.

Possible Prior Art

One possible prior art could be the use of multiple cameras for generating stereoscopic images, but the specific combination of grayscale and color information as described in this patent application may be novel.

How does this technology compare to existing methods for generating stereoscopic images?

The article does not provide a direct comparison to existing methods or technologies in the field.

What are the limitations or challenges of implementing this technology in real-world applications?

The article does not address any potential limitations or challenges that may arise in implementing this technology.

Original Abstract Submitted

in one embodiment, a method by a computing system comprising a color camera and two monochrome cameras respectively associated with two eyes of a user includes computing a point cloud corresponding to a visible environment based at least on two stereoscopic grayscale images respectively captured by the two monochrome cameras, generating a mesh corresponding to the visible environment based on the computed point cloud, and generating two stereoscopic colorized images to be respectively displayed to the two eyes of the user, where each of the two stereoscopic colorized images is generated using (1) the mesh, (2) luminance information from one of the two stereoscopic grayscale images that is associated with the eye to which the stereoscopic colorized image is to be displayed, and (3) color information from a color input image captured by the color camera.