Roblox Corporation (20240349000). AUDIO STREAMS IN MIXED VOICE CHAT IN A VIRTUAL ENVIRONMENT simplified abstract
Contents
AUDIO STREAMS IN MIXED VOICE CHAT IN A VIRTUAL ENVIRONMENT
Organization Name
Inventor(s)
Frederick William Umminger, Iii of Oakland CA (US)
AUDIO STREAMS IN MIXED VOICE CHAT IN A VIRTUAL ENVIRONMENT - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240349000 titled 'AUDIO STREAMS IN MIXED VOICE CHAT IN A VIRTUAL ENVIRONMENT
The abstract describes a metaverse application that processes encoded audio streams associated with avatars in a virtual environment, applies voice activity detection signals, and generates mixed audio output for playback.
- The metaverse application receives encoded audio streams for avatars in a virtual environment.
- Voice activity detection signals are used to identify speech in the audio streams.
- The application determines if an avatar is blocked by a user and if speech is present in the audio stream.
- Additional audio is generated and mixed with the encoded audio.
- The mixed audio is then provided to a speaker for output.
Potential Applications: - Virtual reality communication platforms - Online gaming with voice chat features - Virtual events and conferences with avatar representation
Problems Solved: - Enhancing user experience in virtual environments - Improving audio quality and communication clarity - Managing multiple audio streams in a metaverse setting
Benefits: - Clearer communication between avatars - Realistic audio interactions in virtual environments - Enhanced immersion and engagement for users
Commercial Applications: Title: "Enhancing Virtual Communication with Mixed Audio in Metaverse Applications" This technology can be utilized in virtual reality platforms, online gaming services, and virtual event hosting companies to improve audio communication and user experience. The market implications include increased user engagement, better audio quality, and enhanced virtual interactions.
Questions about the technology: 1. How does the metaverse application differentiate between speech and background noise in the audio streams? 2. What are the potential privacy concerns related to processing audio data in a virtual environment?
Original Abstract Submitted
a metaverse application receives encoded audio that includes a first audio stream associated with a first avatar in a virtual environment and a first voice-activity detection (vad) signal for the first audio stream, and a second audio stream associated with a second avatar in the 3d virtual environment and a second vad signal for the second audio stream. the metaverse application determines that the first avatar is blocked by a user associated with the user avatar. the metaverse application determines that the first vad signal indicates that the first audio stream includes speech. the metaverse application generates additional audio. the metaverse application mixes the additional audio with the encoded audio. the metaverse application provides the mixed audio to a speaker for output.
