18440605. GESTURE DETECTION VIA IMAGE CAPTURE OF SUBDERMAL TISSUE FROM A WRIST-POINTING CAMERA SYSTEM simplified abstract (Google LLC)
Contents
GESTURE DETECTION VIA IMAGE CAPTURE OF SUBDERMAL TISSUE FROM A WRIST-POINTING CAMERA SYSTEM
Organization Name
Inventor(s)
Dongeek Shin of San Jose CA (US)
Andrea Colaco of Los Altos CA (US)
Stiven Guillaume Francois Morvan of New York NY (US)
Adam James Banfield of Troy NY (US)
Shahram Izadi of Tiburon CA (US)
GESTURE DETECTION VIA IMAGE CAPTURE OF SUBDERMAL TISSUE FROM A WRIST-POINTING CAMERA SYSTEM - A simplified explanation of the abstract
This abstract first appeared for US patent application 18440605 titled 'GESTURE DETECTION VIA IMAGE CAPTURE OF SUBDERMAL TISSUE FROM A WRIST-POINTING CAMERA SYSTEM
The patent application describes a system for operating an augmented reality (AR) system by detecting hand gestures formed by a user based on images of the user's wrist acquired from a near-infrared camera.
- The system includes an image capture device on a wristband worn by the user, with light-emitting diodes emitting radiation into the user's wrist and an IR detector capturing two-dimensional images of the dermal layer.
- Gesture detection circuitry analyzes the sequence of images to determine values of a biological flow metric, such as a change in perfusion index (PI), between frames based on a trained model.
- The circuitry then maps these values to specific hand/finger movements to identify the user's gestures accurately.
Potential Applications: - AR gaming and interactive experiences - Virtual reality training simulations - Medical applications for remote patient monitoring and rehabilitation programs
Problems Solved: - Accurate and intuitive gesture recognition for AR systems - Enhanced user experience and interaction in virtual environments
Benefits: - Improved user interface for AR applications - Increased precision and responsiveness in gesture-based interactions - Potential for new and innovative AR experiences
Commercial Applications: Title: "Enhancing User Interaction in Augmented Reality Systems" This technology could be utilized in various industries such as gaming, healthcare, education, and training to create more immersive and engaging experiences for users. The market implications include increased demand for AR devices and software that incorporate advanced gesture recognition capabilities.
Questions about the Technology: 1. How does the system differentiate between different hand gestures accurately? 2. What are the potential limitations of using near-infrared imaging for gesture recognition in AR systems?
Frequently Updated Research: Ongoing research in this field may focus on improving the accuracy and speed of gesture recognition algorithms, expanding the range of detectable gestures, and optimizing the system for real-world applications.
Original Abstract Submitted
Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.
