View source for Snap Inc. (20240248546). CONTROLLING AUGMENTED REALITY EFFECTS THROUGH MULTI-MODAL HUMAN INTERACTION simplified abstract

=CONTROLLING AUGMENTED REALITY EFFECTS THROUGH MULTI-MODAL HUMAN INTERACTION=


==Organization Name==

[[:Category:Snap Inc.|Snap Inc.]]


[[Category:Snap Inc.]]

==Inventor(s)==

[[:Category:Jonathan Solichin of Arcadia CA (US)|Jonathan Solichin of Arcadia CA (US)]][[Category:Jonathan Solichin of Arcadia CA (US)]]

[[:Category:Xinyao Wang of San Francisco CA (US)|Xinyao Wang of San Francisco CA (US)]][[Category:Xinyao Wang of San Francisco CA (US)]]

==CONTROLLING AUGMENTED REALITY EFFECTS THROUGH MULTI-MODAL HUMAN INTERACTION - A simplified explanation of the abstract==


This abstract first appeared for US patent application 20240248546 titled 'CONTROLLING AUGMENTED REALITY EFFECTS THROUGH MULTI-MODAL HUMAN INTERACTION

The patent application describes a multi-modal interaction system that enhances augmented reality experiences on a computer device.

* The system displays AR objects on a graphical user interface and provides textual cues for user guidance.
* Users can interact with the AR objects using hand gestures and voice commands.
* The system modifies the AR objects based on the user's gestures and commands.
* The modified AR objects are then displayed on the GUI for the user to interact with.

Potential Applications:
This technology can be used in gaming, education, training simulations, and virtual tours.

Problems Solved:
Enhances user interaction with AR experiences, improves user engagement, and provides a more immersive experience.

Benefits:
Increased user engagement, enhanced user experience, improved interactivity, and more intuitive controls.

Commercial Applications:
This technology can be utilized in the gaming industry, educational software development, virtual reality training programs, and tourism applications.

Prior Art:
Researchers can explore existing patents related to multi-modal interaction systems, AR technology, and user interface design.

Frequently Updated Research:
Stay informed about advancements in AR technology, user interface design, and interactive systems to enhance the functionality of the multi-modal interaction system.

Questions about Multi-Modal Interaction Systems:
1. How does this technology improve user engagement with augmented reality experiences?
2. What are the potential commercial applications of this multi-modal interaction system?


==Original Abstract Submitted==

systems and methods herein describe a multi-modal interaction system. the multi-modal interaction system, receives a selection of an augmented reality (ar) experience within an application on a computer device, displays a set of ar objects associated with the ar experience on a graphical user interface (gui) of the computer device, display textual cues associated with the set of augmented reality objects on the gui, receives a hand gesture and a voice command, modifies a subset of augmented reality objects of the set of augmented reality objects based on the hand gesture and the voice command, and displays the modified subset of augmented reality objects on the gui.



[[Category:G06F3/01]]
[[Category:G06F3/0481]]
[[Category:G06F3/16]]
[[Category:G06T19/00]]
[[Category:G06V40/10]]
[[Category:CPC_G06F3/017]]