18154678. VIDEO-DERIVED AUDIO PROCESSING simplified abstract (Samsung Electronics Co., Ltd.)
Contents
VIDEO-DERIVED AUDIO PROCESSING
Organization Name
Inventor(s)
Sunil Bharitkar of Stevenson Ranch CA (US)
Carlos Tejeda Ocampo of Tuxtla Gutiérrez (MX)
VIDEO-DERIVED AUDIO PROCESSING - A simplified explanation of the abstract
This abstract first appeared for US patent application 18154678 titled 'VIDEO-DERIVED AUDIO PROCESSING
Simplified Explanation: The patent application describes a method for creating and inserting audio objects and associated metadata into audio or video encoders during content production, based on motion vector analysis of objects in video frames. During content playback, the audio objects are rendered using the metadata without the need for image frame analysis.
Key Features and Innovation:
- Creation of audio objects and metadata during content production based on motion vector analysis.
- Insertion of audio objects and metadata into audio or video encoders.
- Rendering of audio objects during content playback using metadata without image frame analysis.
Potential Applications: This technology can be used in video production, streaming services, virtual reality applications, and interactive media experiences.
Problems Solved: This technology streamlines the process of associating audio with video content, making it more efficient and accurate.
Benefits:
- Improved synchronization of audio and video content.
- Enhanced user experience in multimedia applications.
- Simplified workflow for content creators.
Commercial Applications: The technology can be utilized in film production, online streaming platforms, video game development, and virtual reality experiences, enhancing the overall quality and user engagement.
Prior Art: Prior art related to this technology may include patents or research on audio-visual synchronization methods, motion analysis in video processing, and metadata embedding in multimedia content.
Frequently Updated Research: Researchers may be exploring advancements in motion analysis algorithms, audio-visual synchronization techniques, and metadata standards for multimedia content.
Questions about Audio Object Creation: 1. How does motion vector analysis contribute to the creation of audio objects in this technology? 2. What are the advantages of inserting metadata along with audio objects in the encoding process?
Original Abstract Submitted
One embodiment provides a computer-implemented method that includes creating, during content production, an audio object and metadata associated with the audio object based on a motion vector analysis of an object in one or more image frames in a video. The method can include, during the content production, inserting the audio object and the metadata associated with the audio object into at least one of an audio encoder or a video encoder. The method can include, during content playback, rendering the audio object, without image frame analysis, based on decoding the audio object and parsing the metadata associated with the audio object.
