18426740. LEARNING NEURAL REFLECTANCE SHADERS FROM IMAGES simplified abstract (Intel Corporation)

LEARNING NEURAL REFLECTANCE SHADERS FROM IMAGES

Organization Name

Intel Corporation

Inventor(s)

Benjamin Ummenhofer of Unterhaching (DE)

Shenlong Wang of Santa Clara CA (US)

Sanskar Agrawal of Santa Clara CA (US)

Yixing Lao of Santa Clara CA (US)

Kai Zhang of Santa Clara CA (US)

Stephan Richter of Neubiberg (DE)

Vladlen Koltun of Santa Clara CA (US)

LEARNING NEURAL REFLECTANCE SHADERS FROM IMAGES - A simplified explanation of the abstract

This abstract first appeared for US patent application 18426740 titled 'LEARNING NEURAL REFLECTANCE SHADERS FROM IMAGES

• • Simplified Explanation:**

The patent application describes techniques for learning neural reflectance shaders from images. Machine learning models are trained to optimize illumination and reflectance latent codes for an object in input images, generating a shader for rendering a 3D representation of the object.

• • Key Features and Innovation:**
• Training machine learning models to optimize illumination and reflectance latent codes for objects in images.
• Generating shaders based on the trained models to render 3D representations of objects.

• • Potential Applications:**

This technology can be used in computer graphics, virtual reality, augmented reality, and gaming industries for realistic rendering of objects.

• • Problems Solved:**

This technology addresses the challenge of accurately modeling reflectance properties of objects in images for realistic rendering.

• • Benefits:**
• Improved realism in rendering 3D objects.
• Enhanced visual quality in computer graphics applications.
• Efficient optimization of illumination and reflectance codes.

• • Commercial Applications:**
• "Neural Reflectance Shader Technology for Realistic 3D Rendering"
• This technology can be utilized in the entertainment industry for creating lifelike visual effects in movies and video games.

• • Prior Art:**

Researchers in the field of computer graphics and machine learning have explored similar techniques for optimizing shaders and reflectance properties in 3D rendering.

• • Frequently Updated Research:**

Stay updated on advancements in machine learning models for optimizing shaders and reflectance properties in 3D rendering applications.

• • Questions about Neural Reflectance Shader Technology:**

1. How does this technology improve the realism of 3D rendering? 2. What are the potential applications of neural reflectance shaders in virtual reality environments?

Original Abstract Submitted

Described herein are techniques for learning neural reflectance shaders from images. A set of one or more machine learning models can be trained to optimize an illumination latent code and a set of reflectance latent codes for an object within a set of input images. A shader can then be generated based on a machine learning model of the one or more machine learning models. The shader is configured to sample the illumination latent code and the set of reflectance latent codes for the object. A 3D representation of the object can be rendered using the generated shader.