17948117. Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments simplified abstract (Apple Inc.)

Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments

Organization Name

Apple Inc.

Inventor(s)

Israel Pastrana Vicente of Spring TX (US)

Jonathan R. Dascola of San Francisco CA (US)

Christopher D. Mckenzie of Burlingame CA (US)

Jesse Chand of San Francisco CA (US)

Stephen O. Lemay of Palo Alto CA (US)

Kristi E.S. Bauerly of Los Altos CA (US)

Dorian D. Dargan of Oakland CA (US)

Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments - A simplified explanation of the abstract

This abstract first appeared for US patent application 17948117 titled 'Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments

Abstract Explanation

A computer system is described that displays two user interface objects in a 3D environment. These objects are positioned relative to the user's hand in the physical environment. The system detects the movement of the user's hand, both translationally and rotationally, and adjusts the position and rotation of the user interface objects accordingly.

• The computer system displays two user interface objects in a 3D environment.
• The position of these objects is based on the user's hand location in the physical environment.
• The system tracks the movement of the user's hand, both in translation and rotation.
• Based on the hand movement, the system adjusts the position and rotation of the user interface objects.
• The first user interface object is rotated based on the hand's rotational movement, while the second object remains stationary.

Potential Applications

• Virtual reality applications where users interact with objects in a 3D environment.
• Gaming systems that utilize hand gestures for control and manipulation.
• Training simulations that require users to manipulate objects in a virtual space.
• Design and modeling software that allows users to manipulate objects with hand movements.

Problems Solved

• Provides a more intuitive and immersive way for users to interact with virtual objects.
• Eliminates the need for traditional input devices like controllers or keyboards.
• Allows for more natural and precise control of objects in a 3D environment.
• Enhances the user experience by mimicking real-world hand movements.

Benefits

• Improved user experience and immersion in virtual environments.
• Increased precision and control in manipulating virtual objects.
• Simplified input methods by using hand movements instead of traditional devices.
• Potential for more intuitive and accessible interfaces for individuals with physical limitations.

Original Abstract Submitted

A computer system displays a first and second user interface object in a three-dimensional environment. The first and second user interface objects have a first and second spatial relationship to a first and second anchor position corresponding to a location of a user's hand in a physical environment, respectively. While displaying the first and second user interface objects in the three-dimensional environment, the computer system detects movement of the user's hand in the physical environment, corresponding to a translational movement and a rotational movement of the user's hand relative to a viewpoint, and in response, translates the first and second user interface objects relative to the viewpoint in accordance with the translational movement of the user's hand, and rotates the first user interface object relative to the viewpoint in accordance with the rotational movement of the user's hand without rotating the second user interface object.