Meta platforms technologies, llc (20240338073). FOVEAL REGION PROCESSING FOR ARTIFICIAL REALITY DEVICES simplified abstract

FOVEAL REGION PROCESSING FOR ARTIFICIAL REALITY DEVICES

Organization Name

meta platforms technologies, llc

Inventor(s)

Ilya Brailovskiy of Fremont CA (US)

Sebastian Sztuk of Virum (DK)

Oskar Linde of San Carlos CA (US)

Daniel Maskit of London (GB)

Devraj Gupta of San Diego CA (US)

Zheng Liang of Sunnyvale CA (US)

Rui Xiao of San Jose CA (US)

Gary King of Los Altos CA (US)

FOVEAL REGION PROCESSING FOR ARTIFICIAL REALITY DEVICES - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240338073 titled 'FOVEAL REGION PROCESSING FOR ARTIFICIAL REALITY DEVICES

The abstract describes a computing system that can determine a user's gaze and generate a foveated map to adjust the sensor readout of an image sensor. This system captures an image and modifies it based on the sensor readout.

• The computing system determines the user's gaze and generates a foveated map.
• The foveated map includes foveal regions and sensor readout zones.
• The system adjusts the sensor readout based on the foveated map.
• It captures an image using the image sensor and modifies it according to the sensor readout.

Potential Applications: - This technology can be used in virtual reality and augmented reality applications to enhance user experience. - It can improve the quality of images captured by cameras in smartphones and other devices. - Medical imaging systems can benefit from this technology to focus on specific areas of interest.

Problems Solved: - Adjusting sensor readout based on gaze can improve image quality and reduce processing requirements. - Enhancing user experience in virtual and augmented reality by focusing on the user's gaze. - Providing more accurate and detailed images in medical imaging applications.

Benefits: - Improved image quality and resolution in specific areas of interest. - Enhanced user experience in virtual and augmented reality environments. - Increased efficiency in medical imaging systems.

Commercial Applications: Title: Enhanced Image Capture Technology for Various Industries This technology can be utilized in industries such as gaming, healthcare, and photography to enhance image quality and user experience. It can lead to the development of new products and services that rely on precise image capture and processing.

Questions about the Technology: 1. How does this technology improve image quality compared to traditional methods? 2. What are the potential limitations of using foveated maps in image sensor readouts?

Frequently Updated Research: Researchers are continuously exploring ways to optimize foveated rendering techniques for various applications, including image processing and virtual reality systems. Stay updated on the latest advancements in this field to leverage the full potential of this technology.

Original Abstract Submitted

in one embodiment, a computing system may determine a gaze of a user of the computing system. the computing system may generate a foveated map based on the gaze to determine a sensor readout for an image sensor of the computing system. the foveated map may include several foveal regions. the computing system may determine the sensor readout including several zones corresponding to the image sensor based on the several foveal regions. each of the several zones may indicate a readout resolution for an area of the image sensor for the respective zone. the computing system may capture a first image using the image sensor. the computing system may generate a modified first image based on the captured first image and the sensor readout.