18572840. IMAGE GENERATION simplified abstract (KONINKLIJKE PHILIPS N.V.)

IMAGE GENERATION

Organization Name

KONINKLIJKE PHILIPS N.V.

Inventor(s)

Christiaan Varekamp of Veldhoven (NL)

Bartholomeus Wilhelmus Damianus Van Geest of Veldhoven (NL)

IMAGE GENERATION - A simplified explanation of the abstract

This abstract first appeared for US patent application 18572840 titled 'IMAGE GENERATION

The apparatus described in the patent application is a system that processes captured video data of a real-world scene to generate an output image for viewing from a different perspective.

• The receiver captures video data of a real-world scene and is linked with a capture pose region.
• The store stores a 3D mesh model of the real-world scene.
• The renderer generates an output image for a viewport for a viewing pose.
• The first circuit generates image data by projecting captured video data to the viewing pose.
• The second circuit determines image data for a specific region of the output image based on the 3D mesh model.
• The third circuit combines the first and second image data to create the final output image.
• The fourth circuit determines the specific region based on the deviation of the viewing pose from the capture pose region.

Potential Applications: - Augmented reality applications - Virtual reality experiences - Gaming industry for realistic graphics

Problems Solved: - Providing a seamless transition between captured video data and 3D mesh models - Enhancing the viewing experience by incorporating real-world elements into virtual environments

Benefits: - Improved realism in virtual environments - Enhanced user experience in augmented reality applications - More accurate rendering of real-world scenes in virtual settings

Commercial Applications: Title: Enhanced Virtual Reality Rendering System This technology can be utilized in the gaming industry, architectural visualization, virtual tours for real estate, and training simulations for various industries.

Prior Art: Prior art related to this technology may include research on 3D rendering techniques, augmented reality systems, and computer vision algorithms.

Frequently Updated Research: Researchers are constantly exploring new methods to improve the integration of real-world elements into virtual environments, such as advanced rendering algorithms and machine learning techniques.

Questions about the Technology: 1. How does this technology improve the user experience in virtual reality applications? 2. What are the key challenges in accurately rendering real-world scenes in virtual environments?

Original Abstract Submitted

An apparatus comprises a receiver () receiving captured video data for a real world scene and being linked with a capture pose region. A store () stores a 3D mesh model of the real world scene. A renderer () generates an output image for a viewport for a viewing pose. The renderer () comprises a first circuit () arranged to generate first image data for the output image by projection of captured video data to the viewing pose and second circuit () arranged to determine second image data for a first region of the output image in response to the three-dimensional mesh model. A third circuit () generates the output image to include at least some of the first image data and to include the second image data for the first region. A fourth circuit () determines the first region based on a deviation of the viewing pose relative to the capture pose region.