RAKUTEN MOBILE, INC. (20240221321). IMAGE PROCESSING FOR GENERATING AUGMENTED REALITY IMAGE simplified abstract

IMAGE PROCESSING FOR GENERATING AUGMENTED REALITY IMAGE

Organization Name

RAKUTEN MOBILE, INC.

Inventor(s)

Ryo Kudo of Tokyo (JP)

Kelvin Ka Sin Cheng of Tokyo (JP)

Madoka Inoue of Tokyo (JP)

Takashi Katagiri of Tokyo (JP)

IMAGE PROCESSING FOR GENERATING AUGMENTED REALITY IMAGE - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240221321 titled 'IMAGE PROCESSING FOR GENERATING AUGMENTED REALITY IMAGE

Simplified Explanation: The patent application describes an augmented reality system that creates a virtual viewpoint image from a specific location in a virtual world. It then determines if a simulated object in the virtual world, corresponding to a real object in the real world, overlaps with a different virtual object. If there is an overlap, it generates an augmented reality object for display on a transmissive display.

• The system generates a virtual viewpoint image from a designated position in a virtual world.
• It checks if a simulated object in the virtual world overlaps with a different virtual object.
• If there is an overlap, it creates an augmented reality object for display.
• The augmented reality object corresponds to the virtual object based on their positional relationship in the virtual viewpoint image.
• The system displays the augmented reality object on a transmissive display.

Potential Applications: 1. Augmented reality gaming experiences. 2. Interactive educational tools. 3. Architectural and interior design visualization. 4. Virtual try-on for fashion and cosmetics. 5. Industrial training simulations.

Problems Solved: 1. Enhancing user experience in augmented reality environments. 2. Improving the accuracy of virtual object interactions. 3. Facilitating seamless integration of real and virtual worlds. 4. Providing innovative solutions for various industries. 5. Enhancing visualizations for design and training purposes.

Benefits: 1. Enhanced immersion in augmented reality experiences. 2. Improved accuracy in virtual object placements. 3. Seamless integration of real and virtual elements. 4. Innovative solutions for interactive applications. 5. Enhanced visualization capabilities for design and training.

Commercial Applications: Augmented Reality Object Generation System for Enhanced User Experiences in Gaming, Education, Design, and Training.

Questions about Augmented Reality Object Generation System: 1. How does the system determine the positional relationship between simulated and virtual objects? 2. What are the potential limitations of the augmented reality object generation process?

Original Abstract Submitted

an augmented reality system generates a virtual viewpoint image from a designated position in a virtual world; determines whether or not, in the virtual viewpoint image, a simulated object in the virtual world that corresponds to a real object in a real world overlaps a virtual object that is present in the virtual world and is different from the simulated object; in a case where it is determined that the simulated object overlaps the virtual object in the virtual viewpoint image, generates an ar (augmented reality) object for an ar image that corresponds to the virtual object according to a positional relationship between the simulated object and the virtual object in the virtual viewpoint image; and displays the ar object in a transmissive display.