20240046556. IMAGE RECONSTRUCTION WITH VIEW-DEPENDENT SURFACE IRRADIANCE simplified abstract (Varjo Technologies Oy)
Contents
IMAGE RECONSTRUCTION WITH VIEW-DEPENDENT SURFACE IRRADIANCE
Organization Name
Inventor(s)
Mikko Strandborg of Hangonkylä (FI)
IMAGE RECONSTRUCTION WITH VIEW-DEPENDENT SURFACE IRRADIANCE - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240046556 titled 'IMAGE RECONSTRUCTION WITH VIEW-DEPENDENT SURFACE IRRADIANCE
Simplified Explanation
The abstract describes a computer-implemented method that involves receiving visible-light images captured from different viewpoints using visible-light cameras. A 3D model of a real-world environment is created, where the model stores color information related to the surfaces of real objects. The 3D points on the surfaces of the objects are divided into groups based on factors such as the angle between surface normals, differences in materials, and differences in textures. For each group of 3D points, at least two visible-light images are determined, which represent different surface irradiances of the group. Information indicating these different surface irradiances is stored in the 3D model.
- The method involves creating a 3D model of a real-world environment using visible-light images captured from different viewpoints.
- The 3D model stores color information pertaining to the surfaces of real objects.
- The 3D points on the surfaces of the objects are divided into groups based on factors such as surface normals, materials, and textures.
- For each group of 3D points, at least two images are determined, representing different surface irradiances.
- Information indicating these different surface irradiances is stored in the 3D model.
Potential Applications:
- Augmented reality: The 3D model can be used to overlay virtual objects onto the real-world environment, enhancing the user's perception of reality.
- Virtual reality: The 3D model can be utilized to create immersive virtual environments that accurately represent real-world surfaces and objects.
- Computer graphics: The 3D model can be used for realistic rendering and simulation of real-world scenes in movies, video games, and other visual media.
Problems Solved:
- Accurate representation of real-world surfaces: The method allows for the creation of a 3D model that stores color information, providing a more realistic representation of real objects and their surfaces.
- Surface irradiance variation: By determining different surface irradiances for groups of 3D points, the method addresses the challenge of capturing and representing variations in surface lighting conditions.
Benefits:
- Enhanced visual realism: The method improves the visual realism of augmented reality, virtual reality, and computer graphics applications by accurately representing the color and lighting variations of real-world surfaces.
- Improved user experience: Users of augmented reality and virtual reality applications can benefit from a more immersive and believable experience due to the accurate representation of real objects.
- Increased efficiency: The method automates the process of creating a 3D model and determining surface irradiances, saving time and effort compared to manual methods.
Original Abstract Submitted
a computer-implemented method including: receiving visible-light images captured from viewpoints using visible-light camera(s); creating 3d model of real-world environment, wherein 3d model stores colour information pertaining to 3d points on surfaces of real objects (); dividing 3d points into groups of 3d points, based on at least one of: whether surface normal of 3d points in group lie within predefined threshold angle from each other, differences in materials of real objects, differences in textures of surfaces of real objects; for group of 3d points, determining at least two of visible-light images in which group of 3d points is captured from different viewpoints, wherein said images are representative of different surface irradiances of group of 3d points; and storing, in 3d model, information indicative of different surface irradiances.
