Meta Platforms Technologies, LLC (20240320906). GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES simplified abstract

From WikiPatents
Jump to navigation Jump to search

GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES

Organization Name

Meta Platforms Technologies, LLC

Inventor(s)

Zhang Jia of San Jose CA (US)

Ajit Ninan of San Jose CA (US)

Tsz Tai Chan of Hong Kong (CN)

Minchen Wei of Hong Kong (CN)

GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240320906 titled 'GAZE-AWARE TONE MAPPING WITH ADAPTIVE SPARKLES

Simplified Explanation: The patent application discusses the use of gaze direction information in combination with other data to enhance virtual or augmented reality displays through tone mapping, brightness adaptation, and sparkle generation.

Key Features and Innovation:

  • Speed of light adaptation based on the user's gaze movement.
  • Adjustment of sparkles from smaller objects based on object size, background brightness, and object location relative to the user's gaze.
  • Obtaining specularity of objects from specularity maps or image processing.
  • Shimmering local sparkles as the user's head rotates to create a realistic glistening effect.

Potential Applications: This technology can be applied in virtual reality gaming, augmented reality applications, training simulations, and entertainment experiences.

Problems Solved: The technology addresses the need for realistic lighting and sparkle effects in virtual and augmented reality environments to enhance user immersion and engagement.

Benefits: The benefits of this technology include improved visual realism, enhanced user experience, and increased engagement in virtual and augmented reality content.

Commercial Applications: Potential commercial applications include virtual reality gaming, augmented reality advertising, virtual tours, and immersive training simulations for various industries.

Questions about Gaze Direction Technology: 1. How does gaze direction information enhance virtual and augmented reality displays? 2. What are the key benefits of incorporating gaze direction data into tone mapping and sparkle generation algorithms?

Frequently Updated Research: Ongoing research in this field focuses on optimizing gaze direction technology for various display devices and exploring new applications in different industries.


Original Abstract Submitted

information relating to gaze direction is used, e.g., with other information, to perform tone mapping, brightness adaptation, and/or sparkle generation/management for virtual or augmented reality displays. for example, speed of light adaptation may be increased as a user's gaze moves from a darker scene to a brighter scene and decreased in opposite direction to match human perception dynamics in real world. sparkles from smaller objects may be adjusted depending on an object size, a brightness of the object's background, and/or the object's location relative to the user's gaze—that is, whether the object in the user's focus or in a periphery. specularity of the objects may be obtained from a specularity map (e.g., metadata associated with each object) or from image processing a scene. local sparkles may be shimmered as the user's head rotates deterministically or randomly to provide a sense of real-life glistening.