Meta platforms technologies, llc (20250124648). SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY
SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY
Organization Name
meta platforms technologies, llc
Inventor(s)
Alberto Garcia Garcia of Zurich CH
Gian Diego Tipaldi of Zurich CH
SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY
This abstract first appeared for US patent application 20250124648 titled 'SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY
Original Abstract Submitted
in one embodiment for generating passthrough, a system may receive an image and depth measurements of an environment and generate a corresponding 3d model. the system identifies, in the image, first pixels depicting a physical object and second pixels corresponding to a padded boundary around the first pixels. the system associates the first pixels with a first portion of the 3d model representing the physical object and a first representative depth value computed based on the depth measurements. the system associates the second pixels with a second portion of the 3d model representing a region around the physical object and a second representative depth value farther than the first representative depth value. the system renders an output image depicting a virtual object and the physical object. occlusions between the virtual object and the physical object are determined using the first representative depth value and the second representative depth value.