Snap Inc. (20240265658). FINGERNAIL SEGMENTATION AND TRACKING simplified abstract
Contents
FINGERNAIL SEGMENTATION AND TRACKING
Organization Name
Inventor(s)
Maksym Bekuzarov of Abu Dhabi (AE)
Andrii Didkivskyi of Kyiv (UA)
Sergei Korolev of Mariana del Rey CA (US)
FINGERNAIL SEGMENTATION AND TRACKING - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240265658 titled 'FINGERNAIL SEGMENTATION AND TRACKING
- Simplified Explanation:**
This patent application describes an extended reality (XR) system that allows virtual objects to be displayed in a hand-centric XR experience. The system captures video frame data of the user's hand, detects the hand using a hand-detecting model, generates a 3D model of a portion of the hand, and displays virtual objects in the XR user interface.
- Key Features and Innovation:**
- XR system for displaying virtual objects in a hand-centric XR experience
- Captures video frame data of the user's hand
- Detects the hand using a hand-detecting model
- Generates a 3D model of a portion of the user's hand
- Displays virtual objects in the XR user interface
- Potential Applications:**
This technology can be used in virtual reality gaming, training simulations, medical simulations, and interactive design applications.
- Problems Solved:**
This technology addresses the need for more immersive and interactive XR experiences by allowing users to interact with virtual objects using their hands.
- Benefits:**
- Enhanced user experience in XR applications
- Improved hand tracking and interaction capabilities
- Increased realism and immersion in virtual environments
- Commercial Applications:**
Potential commercial applications include XR gaming, virtual training programs, medical simulations, and interactive design tools.
- Prior Art:**
Prior art related to this technology may include hand tracking systems in virtual reality applications and interactive design tools.
- Frequently Updated Research:**
Research on hand tracking technology, XR user interfaces, and virtual object manipulation in XR environments is frequently updated and relevant to this technology.
- Questions about XR:**
1. How does this technology improve user interaction in XR experiences? 2. What are the potential limitations of hand-centric XR systems?
Original Abstract Submitted
an extended reality (xr) system provides methodologies for displaying virtual objects in a hand-centric xr experience. the xr system provides an xr user interface of an xr system to a user. the xr system captures video frame data of a hand of the user and detects the hand of the user based on the video frame data and a hand-detecting model. the xr system generates a cropping boundary box based on the detection of the hand and the video frame data and generates cropped video frame data based on the cropping boundary box and the video frame data. the xr system generates a 3d model of a portion of the hand of the user based on the cropped video frame data and a virtual object based on the 3d model of the portion of the hand of the user and a 3d texture. the xr displays the virtual object in the xr user interface.
