Meta platforms technologies, llc (20240320906). GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES simplified abstract
Contents
GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES
Organization Name
meta platforms technologies, llc
Inventor(s)
Ajit Ninan of San Jose CA (US)
Tsz Tai Chan of Hong Kong (CN)
GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240320906 titled 'GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES
Simplified Explanation: The patent application discusses the use of gaze direction information in combination with other data to enhance virtual or augmented reality displays through tone mapping, brightness adaptation, and sparkle generation.
Key Features and Innovation:
- Utilizes gaze direction to adjust speed of light adaptation based on changes in scene brightness.
- Modifies sparkle effects on objects based on object size, background brightness, and user gaze location.
- Obtains object specularity from specularity maps or image processing.
- Shimmers local sparkles as the user's head rotates to simulate real-life glistening.
Potential Applications: This technology can be applied in virtual reality gaming, augmented reality applications, training simulations, and interactive displays.
Problems Solved: Addresses the challenge of creating realistic visual effects in virtual and augmented reality environments to enhance user experience and immersion.
Benefits: Enhances user engagement and immersion in virtual and augmented reality environments by dynamically adjusting visual effects based on gaze direction and scene context.
Commercial Applications: Potential commercial applications include virtual reality gaming, augmented reality advertising, training simulations for various industries, and interactive museum exhibits.
Questions about Gaze Direction Technology: 1. How does gaze direction information enhance the user experience in virtual and augmented reality displays? 2. What are the key factors considered when adjusting visual effects based on gaze direction?
Frequently Updated Research: Stay updated on advancements in gaze tracking technology, eye-tracking algorithms, and real-time rendering techniques for virtual and augmented reality displays.
Original Abstract Submitted
information relating to gaze direction is used, e.g., with other information, to perform tone mapping, brightness adaptation, and/or sparkle generation/management for virtual or augmented reality displays. for example, speed of light adaptation may be increased as a user's gaze moves from a darker scene to a brighter scene and decreased in opposite direction to match human perception dynamics in real world. sparkles from smaller objects may be adjusted depending on an object size, a brightness of the object's background, and/or the object's location relative to the user's gaze—that is, whether the object in the user's focus or in a periphery. specularity of the objects may be obtained from a specularity map (e.g., metadata associated with each object) or from image processing a scene. local sparkles may be shimmered as the user's head rotates deterministically or randomly to provide a sense of real-life glistening.
