Meta Platforms Technologies, LLC (20240346729). SYNCHRONIZING VIDEO OF AN AVATAR WITH LOCALLY CAPTURED AUDIO FROM A USER CORRESPONDING TO THE AVATAR simplified abstract

From WikiPatents
Jump to navigation Jump to search

SYNCHRONIZING VIDEO OF AN AVATAR WITH LOCALLY CAPTURED AUDIO FROM A USER CORRESPONDING TO THE AVATAR

Organization Name

Meta Platforms Technologies, LLC

Inventor(s)

Plamen Alexandrov Ivanov of Goleta CA (US)

Antti Kelloniemi of Redwood City CA (US)

SYNCHRONIZING VIDEO OF AN AVATAR WITH LOCALLY CAPTURED AUDIO FROM A USER CORRESPONDING TO THE AVATAR - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240346729 titled 'SYNCHRONIZING VIDEO OF AN AVATAR WITH LOCALLY CAPTURED AUDIO FROM A USER CORRESPONDING TO THE AVATAR

Simplified Explanation: The patent application describes a system where multiple users in a local area use headsets to communicate with each other and with users in a remote area. The headsets have sensors and cameras to capture information about the local area, and modify avatars to synchronize with audio from other users.

  • Acoustic sensors, transducer array, and external capturing sensors are used in the headsets.
  • Avatars are modified to synchronize with audio from other users in the local area.
  • Face tracking is provided through internal imaging devices.
  • Information captured is sent to a server for users in the remote area.
  • The system enhances communication and interaction between users in different locations.

Potential Applications: This technology can be used in virtual reality gaming, remote collaboration, virtual meetings, and teleconferencing.

Problems Solved: The technology addresses the challenge of creating a more immersive and synchronized communication experience for users in different locations.

Benefits: The system enhances user engagement, improves communication quality, and provides a more realistic virtual interaction experience.

Commercial Applications: "Immersive Communication System for Local and Remote Users" can be utilized in the gaming industry, virtual events, remote team collaboration, and telecommunication services.

Prior Art: Prior research in the field of virtual reality communication systems and avatar synchronization can provide insights into similar technologies.

Frequently Updated Research: Stay updated on advancements in virtual reality communication systems, avatar technology, and remote collaboration tools for potential improvements in the system.

Questions about Immersive Communication System for Local and Remote Users: 1. How does the system ensure synchronization between avatars and audio from other users? 2. What are the potential privacy concerns related to capturing and sharing user information in this system?


Original Abstract Submitted

a local area includes multiple users each using a headset to communicate with other users in the local area, as well as with additional users in a remote area. the headset includes one or more acoustic sensors, a transducer array, one or more external capturing sensors (e.g., cameras) capturing information describing the local area. a headset of a user in the local area local detects audio from an additional user in the local area. in response to detecting the audio, an avatar representing the additional user that is displayed by the user's headset is modified to appear to be synchronized with the audio from the additional user that is heard by the user. additionally, each headset provides respective face tracking through one or more internal imaging devices that is provided with and captured audio to a server which provides the information users in the remote area.