Meta Platforms Technologies, LLC (20240249478). GAZE-BASED SUPER-RESOLUTION FOR EXTENDED REALITY DEVICES simplified abstract
Contents
GAZE-BASED SUPER-RESOLUTION FOR EXTENDED REALITY DEVICES
Organization Name
Meta Platforms Technologies, LLC
Inventor(s)
Ilya Brailovskiy of Fremont CA (US)
Steven Paul Lansel of Apopka FL (US)
Grant Kaijuin Yang of San Bruno CA (US)
GAZE-BASED SUPER-RESOLUTION FOR EXTENDED REALITY DEVICES - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240249478 titled 'GAZE-BASED SUPER-RESOLUTION FOR EXTENDED REALITY DEVICES
The abstract describes a method implemented by a computing device that involves rendering an extended reality (XR) environment on displays and determining the context of the XR environment with respect to a user, including characteristics associated with the user's eye.
- Generating a foveated map based on the characteristics associated with the user's eye, which includes a plurality of foveal regions corresponding to low-resolution areas of the content.
- Inputting zones of the foveated map into a machine-learning model trained to generate a super-resolution reconstruction based on regions of interest identified within the zones.
- Outputting the super-resolution reconstruction of the foveated map by the machine-learning model.
Potential Applications: - Virtual reality and augmented reality applications - Gaming industry for enhanced graphics - Medical field for detailed visualization in surgeries
Problems Solved: - Enhancing the visual experience in XR environments - Improving the resolution of content based on user's eye characteristics
Benefits: - Enhanced user experience in XR environments - Improved clarity and detail in displayed content - Personalized visual experience based on user's eye characteristics
Commercial Applications: Title: "Enhanced Visual Experience Technology for XR Environments" This technology can be used in industries such as gaming, healthcare, education, and entertainment to provide users with a more immersive and detailed XR experience. It can also be integrated into devices like VR headsets and AR glasses to enhance visual quality.
Questions about the technology: 1. How does this technology improve the user experience in XR environments? - This technology enhances the user experience by generating a super-resolution reconstruction of the foveated map based on the user's eye characteristics, resulting in improved clarity and detail in displayed content. 2. What are the potential commercial applications of this technology? - This technology can be applied in various industries such as gaming, healthcare, education, and entertainment to provide users with a more immersive and detailed XR experience.
Original Abstract Submitted
a method implemented by a computing device includes rendering on displays of a computing device an extended reality (xr) environment, and determining a context of the xr environment with respect to a user. determining the context includes determining characteristics associated with an eye of the user with respect to content displayed. the method includes generating, based on the characteristics associated with the eye, a foveated map including a plurality of foveal regions. the plurality of foveal regions includes a plurality of zones each corresponding to a low-resolution area of the content for the respective zone. the method includes inputting one or more of the plurality of zones into a machine-learning model trained to generate a super-resolution reconstruction of the foveated map based on regions of interest identified within the one or more of the plurality of zones, and outputting, by the machine-learning model, the super-resolution reconstruction of the foveated map.
