18244864. Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments simplified abstract (Apple Inc.)

Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments

Organization Name

Apple Inc.

Inventor(s)

Jeffrey M. Faulkner of San Francisco CA (US)

Israel Pastrana Vicente of Spring TX (US)

Philipp Rockel of San Francisco CA (US)

Robert T. Tilton of Los Angeles CA (US)

Stephen O. Lemay of Palo Alto CA (US)

William A. Sorrentino, Iii of Mill Valley CA (US)

Kristi E.S. Bauerly of Los Altos CA (US)

Peter D. Anton of Portola Valley CA (US)

Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments - A simplified explanation of the abstract

This abstract first appeared for US patent application 18244864 titled 'Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments

Simplified Explanation

An electronic device is described that can detect a user's gaze towards a virtual object in a three-dimensional environment. The device also detects if the user's hand is in a ready state for providing gesture inputs.

• The device displays interaction options for the virtual object if the user's gaze meets certain criteria and their hand is in the ready state for gestures.
• If the user's hand is not in the ready state, the device does not display the interaction options for the virtual object.

Potential Applications

• Virtual reality gaming: Users can interact with virtual objects in a game using their gaze and gestures.
• Augmented reality applications: Users can manipulate virtual objects in a real-world environment using gaze and gestures.
• Training simulations: Users can practice specific tasks by interacting with virtual objects using their gaze and gestures.

Problems Solved

• Enhances user experience by providing intuitive ways to interact with virtual objects.
• Reduces the need for physical controllers or buttons, making the interaction more natural and immersive.
• Allows for more precise and accurate interactions by combining gaze and gesture inputs.

Benefits

• Improved user engagement and immersion in virtual environments.
• Simplified and intuitive interaction methods.
• Increased accuracy and precision in interacting with virtual objects.

Original Abstract Submitted

An electronic device, while displaying a three-dimensional environment, including one or more virtual objects, detects gaze of a user directed toward a first virtual object in the three-dimensional environment. The gaze meets first criteria and the first virtual object is responsive to at least one gesture input. In response to detecting the gaze that meets the first criteria, in accordance with a determination that a hand is in a predefined ready state for providing gesture inputs, the electronic device displays an indication of one or more interaction options available for the first virtual object in the three-dimensional environment; and in accordance with a determination the hand is not in the predefined ready state for providing gesture inputs, the electronic device forgoes displaying the indication of one or more interaction options available for the first virtual object.