18036379. MIXED REALITY DISPLAY METHOD, MIXED REALITY DEVICE, AND STORAGE MEDIUM simplified abstract (BOE Technology Group Co., Ltd.)
Contents
MIXED REALITY DISPLAY METHOD, MIXED REALITY DEVICE, AND STORAGE MEDIUM
Organization Name
BOE Technology Group Co., Ltd.
Inventor(s)
MIXED REALITY DISPLAY METHOD, MIXED REALITY DEVICE, AND STORAGE MEDIUM - A simplified explanation of the abstract
This abstract first appeared for US patent application 18036379 titled 'MIXED REALITY DISPLAY METHOD, MIXED REALITY DEVICE, AND STORAGE MEDIUM
Simplified Explanation
The patent application describes a method for displaying mixed reality content using a mixed reality device. Here are the key points:
- The method involves tracking the user's eyeballs using an eyeball tracker after receiving a mixed display signal.
- The gaze point of the user on the display screen is determined based on the tracked eyeballs.
- A sub-display region on the display screen is determined based on the correspondence between the gaze point and the sub-display region.
- An image sensor in an image sensor array is selected based on the correspondence between the sub-display region and the image sensor.
- The selected image sensor is adjusted accordingly.
- The method then superimposes and renders an environment image captured by the image sensor array with a virtual image.
- The resulting mixed reality image is obtained and displayed.
Potential applications of this technology:
- Gaming: The mixed reality display method can be used to enhance gaming experiences by overlaying virtual objects onto the real world.
- Training and Simulation: The method can be utilized in training and simulation scenarios to provide realistic mixed reality environments.
- Design and Visualization: Architects, engineers, and designers can use this technology to visualize and interact with virtual models in real-world settings.
Problems solved by this technology:
- Accurate Gaze Tracking: The method solves the problem of accurately tracking the user's gaze point on the display screen, allowing for precise interaction with mixed reality content.
- Seamless Integration of Real and Virtual Worlds: By superimposing and rendering the environment image and virtual image, the method enables a seamless integration of real and virtual worlds, creating an immersive mixed reality experience.
Benefits of this technology:
- Enhanced User Experience: The method provides an enhanced user experience by combining real-world elements with virtual content, creating a more immersive and interactive environment.
- Improved Precision: The accurate gaze tracking and adjustment of image sensors ensure precise rendering of mixed reality content, improving the overall quality of the experience.
- Versatile Applications: The technology can be applied in various fields, including gaming, training, design, and visualization, offering a wide range of possibilities for its use.
Original Abstract Submitted
Provided are a mixed reality display method, a mixed reality device, and a storage medium. The method includes: after receiving a mixed display signal, tracking the eyeballs of a user by means of an eyeball tracker, and determining a gaze point of the user on a display screen; determining, according to a correspondence between the gaze point and a sub-display region in the display screen, the sub-display region the user gazes; determining at least one first image sensor according to a correspondence between the sub-display region and an image sensor in an image sensor array, and adjusting the at least one first image sensor; and superimposing and rendering an environment image output by the image sensor array and a virtual image, and obtaining and displaying an MR image.
