Meta platforms technologies, llc (20240281070). Simultaneous Controller and Touch Interactions simplified abstract
Simultaneous Controller and Touch Interactions
Organization Name
meta platforms technologies, llc
Inventor(s)
Ali Emami of San Diego CA (US)
Aaron Selig of Belmont CA (US)
Ahad Habib Basravi of Oakland CA (US)
James Michael-K O'donnell of Menlo Park CA (US)
Nathaniel Lane of Wrentham MA (US)
Todd Harris of Woodinville WA (US)
Simultaneous Controller and Touch Interactions - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240281070 titled 'Simultaneous Controller and Touch Interactions
Simplified Explanation:
The patent application describes an artificial reality (XR) system that allows users to interact with virtual environments using XR controllers and hand gestures simultaneously.
- XR system includes XR controllers and hand gestures
- Users can use controllers for distance interaction and interactions requiring controller buttons
- System recognizes when user extends finger to manually touch objects
- Users can touch UI elements using fingers while holding controllers
- System identifies finger not touching controller and processes hand input from finger
Key Features and Innovation:
- Simultaneous use of XR controllers and hand gestures
- Recognition of finger gestures for manual interactions
- Seamless integration of finger touch with controller interactions
- Efficient processing of hand input without user needing to put down controller
- Enhanced user experience in virtual environments
Potential Applications:
- Virtual reality gaming
- Training simulations
- Architectural design
- Medical simulations
- Virtual collaboration tools
Problems Solved:
- Enhancing user interaction in XR environments
- Improving user experience in virtual reality
- Streamlining manual interactions in artificial reality systems
Benefits:
- Enhanced user immersion
- Improved user control
- Increased efficiency in virtual interactions
- Seamless integration of hand gestures with controller inputs
Commercial Applications:
The technology could be utilized in various industries such as gaming, training, design, healthcare, and virtual collaboration tools. It has the potential to revolutionize user experiences in XR environments and enhance productivity in various fields.
Questions about XR:
1. How does the XR system differentiate between controller inputs and hand gestures? 2. What are the potential limitations of using hand gestures in XR environments?
Original Abstract Submitted
an artificial reality (xr) system includes xr controllers and hand gestures and corresponding representation of the hand gestures in xr space. example implementations allow a user to use controllers for distance interaction and interactions that require controller buttons, but also recognize when the user extends her finger and wants to manually touch things-using touch in conjunction with controllers. thus, if the user has a controller in her hand and wants to touch a ui element, she can also use her finger. in particular, the system identifies the finger is not touching the controller (e.g., via capacitance sensors) and that a hand pose is present (e.g., finger extended—from camera), thereby processing hand input from the finger without the user having to put down the controller.
