17936490. Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience simplified abstract (Meta Platforms Technologies, LLC)

From WikiPatents
Jump to navigation Jump to search

Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience

Organization Name

Meta Platforms Technologies, LLC

Inventor(s)

Alex Elsayad of Toronto (CA)

Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience - A simplified explanation of the abstract

This abstract first appeared for US patent application 17936490 titled 'Translating Interactions on a Two-Dimensional Interface to an Artificial Reality Experience

Simplified Explanation

The patent application describes a technology that maps an interaction plane in a three-dimensional scene to a two-dimensional screen, allowing users to interact with virtual objects in XR environments using their mobile phones.

  • The technology maps an interaction plane in a 3D scene to a 2D screen for intuitive and natural interaction.
  • The interaction plane can be fixed or dynamically changeable, enabling users to send inputs through the 2D screen.
  • This mapping allows for parity between XR and non-XR interfaces, enhancing user experience and interaction with virtual objects.

Potential Applications

The technology can be applied in various industries such as gaming, education, training, and virtual simulations to enhance user interaction and engagement in XR environments.

Problems Solved

1. Difficulty in translating XR experiences to 2D screens in a natural and intuitive way. 2. Lack of parity between XR and non-XR interfaces, limiting user interaction with virtual objects.

Benefits

1. Enhanced user experience in XR environments through intuitive interaction. 2. Improved engagement and immersion in XR applications. 3. Increased usability of XR technology on mobile devices.

Potential Commercial Applications

"Enhancing User Interaction in XR Environments Using Mobile Devices"

Possible Prior Art

There may be prior art related to mapping 3D interactions to 2D screens in XR environments, but specific examples are not provided in the patent application.

Unanswered Questions

How does the technology handle complex 3D scenes with multiple interaction planes?

The patent application does not specify how the technology manages complex 3D scenes with multiple interaction planes for mapping to 2D screens.

What are the limitations of the technology in terms of device compatibility and processing power?

The patent application does not address the potential limitations of the technology in terms of device compatibility and processing power required for mapping 3D interactions to 2D screens.


Original Abstract Submitted

Many users access artificial reality (XR) experiences through their mobile phones. However, it is difficult to translate XR experiences to a two-dimensional (2D) screen in a way that feels intuitive and natural. Thus, the technology can map an interaction plane in a three-dimensional (3D) scene to the 2D screen with as many affordances as possible, even if the plane is not parallel to the mobile phone. The plane can be a fixed surface or a dynamically changeable surface through which the user sends inputs through the 2D screen. The mapping of the plane to the 2D screen can control interaction with a virtual object on the interaction plane in the XR environment, enabling parity between the same experience on XR and non-XR interfaces.