18310622. Simultaneous Controller and Touch Interactions simplified abstract (Meta Platforms Technologies, LLC)
Simultaneous Controller and Touch Interactions
Organization Name
Meta Platforms Technologies, LLC
Inventor(s)
Ali Emami of San Diego CA (US)
Aaron Selig of Belmont CA (US)
Ahad Habib Basravi of Oakland CA (US)
James Michael-K O'donnell of Menlo Park CA (US)
Nathaniel Lane of Wrentham MA (US)
Todd Harris of Woodinville WA (US)
Simultaneous Controller and Touch Interactions - A simplified explanation of the abstract
This abstract first appeared for US patent application 18310622 titled 'Simultaneous Controller and Touch Interactions
Simplified Explanation: The patent application describes an artificial reality (XR) system that allows users to use XR controllers and hand gestures simultaneously in XR space.
- XR system includes XR controllers and hand gestures
- Users can use controllers for distance interaction and interactions requiring controller buttons
- System recognizes when user extends finger to manually touch things
- Users can touch UI elements using finger while holding controller
- System identifies finger not touching controller and processes hand input from finger
Key Features and Innovation:
- Integration of XR controllers and hand gestures in XR space
- Recognition of hand gestures for manual interaction
- Seamless switching between controller and hand gestures for user interaction
Potential Applications:
- Virtual reality gaming
- Training simulations
- Remote collaboration tools
Problems Solved:
- Enhances user interaction in XR space
- Allows for more natural and intuitive interactions
Benefits:
- Improved user experience
- Increased immersion in XR environments
- Enhanced usability of XR systems
Commercial Applications:
- Virtual reality gaming industry
- Training and education sector
- Remote work and collaboration tools market
Questions about XR: 1. How does the XR system differentiate between controller input and hand gestures?
- The system uses sensors to detect when the user's finger is not touching the controller, allowing for hand gesture recognition.
2. What are the potential challenges in implementing hand gestures alongside XR controllers?
- Potential challenges may include ensuring accurate hand gesture recognition and seamless integration with controller inputs.
Original Abstract Submitted
An artificial reality (XR) system includes XR controllers and hand gestures and corresponding representation of the hand gestures in XR space. Example implementations allow a user to use controllers for distance interaction and interactions that require controller buttons, but also recognize when the user extends her finger and wants to manually touch things-using touch in conjunction with controllers. Thus, if the user has a controller in her hand and wants to touch a UI element, she can also use her finger. In particular, the system identifies the finger is not touching the controller (e.g., via capacitance sensors) and that a hand pose is present (e.g., finger extended—from camera), thereby processing hand input from the finger without the user having to put down the controller.
