Robert bosch gmbh (20240134505). SYSTEM AND METHOD FOR MULTI MODAL INPUT AND EDITING ON A HUMAN MACHINE INTERFACE simplified abstract

SYSTEM AND METHOD FOR MULTI MODAL INPUT AND EDITING ON A HUMAN MACHINE INTERFACE

Organization Name

robert bosch gmbh

Inventor(s)

Zhengyu Zhou of Fremont CA (US)

Jiajing Guo of Mountain View CA (US)

Nan Tian of Foster City CA (US)

Nicholas Feffer of Stanford CA (US)

William Ma of Lagrangeville NY (US)

SYSTEM AND METHOD FOR MULTI MODAL INPUT AND EDITING ON A HUMAN MACHINE INTERFACE - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240134505 titled 'SYSTEM AND METHOD FOR MULTI MODAL INPUT AND EDITING ON A HUMAN MACHINE INTERFACE

Simplified Explanation

The patent application describes a virtual reality apparatus that includes a display, microphone, eye gaze sensor, and processor to enhance user interaction through voice commands, eye tracking, and text editing capabilities.

• Display outputs information related to the virtual reality interface
• Microphone receives spoken word commands from the user
• Eye gaze sensor tracks user's eye movement
• Processor responds to inputs by outputting text, emphasizing words, toggling through words, highlighting and editing words, and suggesting words based on contextual information

Potential Applications

This technology could be applied in various fields such as:

• Virtual reality gaming
• Virtual meetings and collaboration
• Language learning and translation tools

Problems Solved

The technology addresses issues such as:

• Improving user interaction in virtual reality environments
• Enhancing accessibility for users with disabilities
• Streamlining text editing and input processes

Benefits

The benefits of this technology include:

• Enhanced user experience in virtual reality
• Improved efficiency in text editing and input tasks
• Increased accessibility for a wider range of users

Potential Commercial Applications

This technology could be utilized in commercial settings such as:

• Virtual reality training simulations
• Virtual reality design and modeling software
• Virtual reality communication platforms

Possible Prior Art

One possible prior art for this technology could be existing virtual reality systems with voice recognition and eye tracking capabilities.

How does this technology impact user privacy and data security?

This article does not address the potential privacy concerns or data security measures implemented in the virtual reality apparatus.

What are the system requirements for running this virtual reality apparatus?

The article does not specify the hardware or software requirements needed to operate this virtual reality system.

Original Abstract Submitted

a virtual reality apparatus that includes a display configured to output information related to a user interface of the virtual reality device, a microphone configured to receive one or more spoken word commands from a user upon activation of a voice recognition session, an eye gaze sensor configured to track eye movement of the user, and a processor programmed to, in response to a first input, output one or more words of a text field, in response to an eye gaze of the user exceeding a threshold time, emphasize a group of one or more words of the text field, toggle through a plurality of words of only the group utilizing the input interface, in response to a second input, highlight and edit an edited word from the group, and in response to utilizing contextual information associated with the group a language model, outputting one or more suggested words.