18381472. Directing a Virtual Agent Based on Eye Behavior of a User simplified abstract (Apple Inc.)
Contents
Directing a Virtual Agent Based on Eye Behavior of a User
Organization Name
Inventor(s)
Dan Feng of Santa Clara CA (US)
Bo Morgan of Emerald Hills CA (US)
Mark E. Drummond of Palo Alto CA (US)
Directing a Virtual Agent Based on Eye Behavior of a User - A simplified explanation of the abstract
This abstract first appeared for US patent application 18381472 titled 'Directing a Virtual Agent Based on Eye Behavior of a User
Simplified Explanation
The abstract describes a method performed on an electronic device that includes processors, memory, and a display. The method involves displaying a virtual agent on the display, which is associated with a first viewing frustum. The first viewing frustum includes a user avatar with a visual representation of one or more eyes. The method also involves obtaining eye tracking data indicative of the user's eye behavior, updating the visual representation of the eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information.
- The method involves displaying a virtual agent on an electronic device.
- The virtual agent is associated with a first viewing frustum, which includes a user avatar with a visual representation of one or more eyes.
- Eye tracking data is obtained to understand the user's eye behavior.
- The visual representation of the eyes is updated based on the eye behavior.
- The virtual agent is directed to perform an action based on the updated eye behavior and scene information.
Potential Applications:
- Virtual reality and augmented reality experiences
- Gaming and interactive entertainment
- User interfaces for electronic devices
- Assistive technologies for individuals with disabilities
Problems Solved:
- Enhancing the realism and immersion of virtual agents by accurately representing eye behavior
- Improving user interaction and engagement in virtual environments
- Providing more natural and intuitive user interfaces
Benefits:
- Enhanced user experience in virtual reality and augmented reality environments
- Improved communication and interaction with virtual agents
- Increased accessibility for individuals with disabilities
- Potential for more realistic and engaging gaming experiences
Original Abstract Submitted
According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
