International business machines corporation (20240303931). GENERATING 3D HAND KEYPOINTS FOR A MIXED REALITY AVATAR simplified abstract
Contents
- 1 GENERATING 3D HAND KEYPOINTS FOR A MIXED REALITY AVATAR
- 1.1 Organization Name
- 1.2 Inventor(s)
- 1.3 GENERATING 3D HAND KEYPOINTS FOR A MIXED REALITY AVATAR - A simplified explanation of the abstract
- 1.4 Simplified Explanation
- 1.5 Potential Applications
- 1.6 Problems Solved
- 1.7 Benefits
- 1.8 Commercial Applications
- 1.9 Prior Art
- 1.10 Frequently Updated Research
- 1.11 Questions about Mixed Reality
- 1.12 Original Abstract Submitted
GENERATING 3D HAND KEYPOINTS FOR A MIXED REALITY AVATAR
Organization Name
international business machines corporation
Inventor(s)
Wei Jun Zheng of Shanghai (CN)
GENERATING 3D HAND KEYPOINTS FOR A MIXED REALITY AVATAR - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240303931 titled 'GENERATING 3D HAND KEYPOINTS FOR A MIXED REALITY AVATAR
Simplified Explanation
The patent application describes a method, computer system, and computer program for mixed reality. It involves generating 3D hand keypoints for a user's visible and uncapturable hands, refining the uncapturable hand keypoints using a generative model, and rendering the 3D keypoints for the user's uncapturable hand using a virtual hand modeler.
- Receiving 3D hand keypoints of a user's visible hand joints.
- Using random noise as initial keypoints for the uncapturable hand joints.
- Inputting received and initial keypoints into a 3D hand joint generative model.
- Refining the uncapturable hand joints using the generative model.
- Identifying synchronization between generated keypoints of the uncapturable hand and the visible hand.
- Rendering the generated 3D keypoints for the user's uncapturable hand using a virtual hand modeler.
Potential Applications
This technology can be used in virtual reality applications, gaming, interactive experiences, training simulations, and medical training.
Problems Solved
The technology addresses the challenge of accurately capturing and rendering hand movements in mixed reality environments.
Benefits
Improved user experience in mixed reality applications, enhanced realism in virtual environments, and better hand tracking accuracy.
Commercial Applications
- Virtual reality gaming
- Interactive training simulations
- Medical training applications
Prior Art
Prior art related to this technology may include research on hand tracking in virtual reality and mixed reality environments.
Frequently Updated Research
Research on advancements in hand tracking technology, virtual reality applications, and mixed reality user interfaces may be relevant to this technology.
Questions about Mixed Reality
How does this technology improve user interaction in virtual environments?
This technology enhances user interaction by accurately capturing and rendering hand movements in mixed reality applications, providing a more immersive experience.
What are the potential limitations of using generative models for refining hand keypoints?
Generative models may have limitations in accurately capturing complex hand movements or variations in hand shapes, which could affect the realism of the rendered hand movements.
Original Abstract Submitted
according to one embodiment, a method, computer system, and computer program product for mixed reality is provided. the present invention may include receiving 3d hand keypoints (keypoints) of a user's visible hand joints from the user's capturable hand, and visible hand joints, if any, from the user's uncapturable hand; using random noise sampled with a unit normal distribution as initial keypoints for the uncapturable hand joints from the user's uncapturable hand; inputting the received and the initial keypoints, in a preset order, into a trained 3d hand joint generative model; performing an iterative refinement of the uncapturable hand joints from the user's uncapturable hand using the trained 3d hand joint generative model; identifying whether generated keypoints of the user's uncapturable hand are synchronized with the keypoints of the user's capturable hand; and rendering the generated 3d keypoints for the user's uncapturable hand joints using a 3d virtual hand modeler.
