View source for 17936490. Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience simplified abstract (Meta Platforms Technologies, LLC)

=Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience=


==Organization Name==

[[:Category:Meta Platforms Technologies, LLC|Meta Platforms Technologies, LLC]]


[[Category:Meta Platforms Technologies, LLC]]

==Inventor(s)==

[[:Category:Alex Elsayad of Toronto (CA)|Alex Elsayad of Toronto (CA)]][[Category:Alex Elsayad of Toronto (CA)]]

==Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience - A simplified explanation of the abstract==


This abstract first appeared for US patent application 17936490 titled 'Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience

==Simplified Explanation==

The patent application describes a technology that maps an interaction plane in a three-dimensional scene to a two-dimensional screen, allowing users to interact with virtual objects in XR environments using their mobile phones.

* The technology maps an interaction plane in a 3D scene to a 2D screen for intuitive and natural interaction.
* The interaction plane can be fixed or dynamically changeable, enabling users to send inputs through the 2D screen.
* This mapping allows for parity between XR and non-XR interfaces, enhancing user experience and interaction with virtual objects.

== Potential Applications ==
The technology can be applied in various industries such as gaming, education, training, and virtual simulations to enhance user interaction and engagement in XR environments.

== Problems Solved ==
1. Difficulty in translating XR experiences to 2D screens in a natural and intuitive way.
2. Lack of parity between XR and non-XR interfaces, limiting user interaction with virtual objects.

== Benefits ==
1. Enhanced user experience in XR environments through intuitive interaction.
2. Improved engagement and immersion in XR applications.
3. Increased usability of XR technology on mobile devices.

== Potential Commercial Applications ==
"Enhancing User Interaction in XR Environments Using Mobile Devices"

== Possible Prior Art ==
There may be prior art related to mapping 3D interactions to 2D screens in XR environments, but specific examples are not provided in the patent application.

== Unanswered Questions ==

=== How does the technology handle complex 3D scenes with multiple interaction planes? ===
The patent application does not specify how the technology manages complex 3D scenes with multiple interaction planes for mapping to 2D screens.

=== What are the limitations of the technology in terms of device compatibility and processing power? ===
The patent application does not address the potential limitations of the technology in terms of device compatibility and processing power required for mapping 3D interactions to 2D screens.


==Original Abstract Submitted==

Many users access artificial reality (XR) experiences through their mobile phones. However, it is difficult to translate XR experiences to a two-dimensional (2D) screen in a way that feels intuitive and natural. Thus, the technology can map an interaction plane in a three-dimensional (3D) scene to the 2D screen with as many affordances as possible, even if the plane is not parallel to the mobile phone. The plane can be a fixed surface or a dynamically changeable surface through which the user sends inputs through the 2D screen. The mapping of the plane to the 2D screen can control interaction with a virtual object on the interaction plane in the XR environment, enabling parity between the same experience on XR and non-XR interfaces.



[[Category:G06F3/04815]]
[[Category:G06F3/0346]]
[[Category:G06F3/04842]]
[[Category:G06F3/04845]]
[[Category:G06F3/04886]]