18444386. Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments simplified abstract (Apple Inc.)
Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
Organization Name
Inventor(s)
Jonathan R. Dascola of San Francisco CA (US)
Stephen O. Lemay of Palo Alto CA (US)
Israel Pastrana Vicente of Spring TX (US)
Peter D. Anton of Portola Valley CA (US)
Kristi E.S. Bauerly of Los Altos CA (US)
Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments - A simplified explanation of the abstract
This abstract first appeared for US patent application 18444386 titled 'Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
Simplified Explanation: The patent application describes a computer system that displays a three-dimensional environment with user interface objects at different positions. It detects gaze input and hand movements to interact with the objects based on specific criteria.
- The computer system displays a three-dimensional environment with user interface objects at distinct positions.
- It detects gaze input directed to a specific region in the environment.
- It also detects hand movements meeting gesture criteria.
- The system selects or forgoes selecting a user interface object based on the timing of the gaze input and hand movement.
Potential Applications: 1. Virtual reality gaming 2. Interactive design software 3. Medical simulations 4. Training simulations for various industries
Problems Solved: 1. Enhancing user interaction in three-dimensional environments 2. Improving user experience in virtual reality applications 3. Streamlining navigation in complex interfaces
Benefits: 1. Enhanced user engagement 2. Improved efficiency in interacting with virtual environments 3. More intuitive user interfaces
Commercial Applications: The technology could be utilized in virtual reality gaming systems, design software for architects and engineers, medical training simulations, and educational tools for immersive learning experiences.
Prior Art: Readers interested in prior art related to this technology could explore patents in the field of virtual reality interfaces, gaze tracking systems, and gesture recognition technologies.
Frequently Updated Research: Researchers are continually exploring advancements in gaze tracking technology, gesture recognition algorithms, and user interface design for virtual environments.
Questions about Three-Dimensional Environment Interaction: 1. How does the system differentiate between intentional and unintentional gaze inputs? 2. What are the potential limitations of hand gesture recognition in complex environments?
Original Abstract Submitted
A computer system displays a first view of a three-dimensional environment, including a first and second user interface objects at distinct first and second positions. While displaying the first view, the computer system detects a first gaze input directed to a first region in the three-dimensional environment corresponding to the first position. While detecting the first gaze input, the computer system detects first movement of a hand meeting first gesture criteria. In accordance with a determination that the first movement is detected after the first gaze input meets first gaze criteria requiring the gaze to be held at the first region for at least a first preset extended amount of time, the computer system selects the first user interface object; and in accordance with a determination that the first movement is detected before the gaze meeting the first gaze criteria, the computer system forgoes selecting the first user interface object.
