Samsung electronics co., ltd. (20240244386). VIDEO-DERIVED AUDIO PROCESSING simplified abstract
Contents
VIDEO-DERIVED AUDIO PROCESSING
Organization Name
Inventor(s)
Sunil Bharitkar of Stevenson Ranch CA (US)
Carlos Tejeda Ocampo of Tuxtla Gutiérrez (MX)
VIDEO-DERIVED AUDIO PROCESSING - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240244386 titled 'VIDEO-DERIVED AUDIO PROCESSING
The abstract of this patent application describes a computer-implemented method that involves creating an audio object and associated metadata during content production based on a motion vector analysis of an object in video frames. The method also includes inserting the audio object and metadata into audio or video encoders during content production, and rendering the audio object during playback based on decoding and parsing the metadata.
- Motion vector analysis of an object in video frames is used to create an audio object and metadata during content production.
- The audio object and metadata are inserted into audio or video encoders during content production.
- The audio object is rendered during playback without image frame analysis, based on decoding and parsing the metadata.
Potential Applications: - This technology could be used in video editing software to automatically generate audio objects based on the motion of objects in video frames. - It could enhance the user experience in virtual reality applications by providing dynamic audio based on the movement of objects in the virtual environment.
Problems Solved: - Simplifies the process of adding audio to video content by automating the creation of audio objects based on motion analysis. - Enhances the synchronization of audio and video elements in multimedia content.
Benefits: - Streamlines the content production process by automating the creation of audio objects. - Improves the immersive experience for users by providing dynamic audio based on the motion of objects in video frames.
Commercial Applications: Title: Automated Audio Object Generation for Multimedia Content Production This technology could be valuable for companies developing video editing software, virtual reality applications, and multimedia content creation tools. It can help streamline the production process and enhance the quality of audio in various multimedia projects.
Questions about Automated Audio Object Generation for Multimedia Content Production: 1. How does motion vector analysis contribute to the creation of audio objects in this technology? 2. What are the potential benefits of automating the generation of audio objects based on object motion in video frames?
Original Abstract Submitted
one embodiment provides a computer-implemented method that includes creating, during content production, an audio object and metadata associated with the audio object based on a motion vector analysis of an object in one or more image frames in a video. the method can include, during the content production, inserting the audio object and the metadata associated with the audio object into at least one of an audio encoder or a video encoder. the method can include, during content playback, rendering the audio object, without image frame analysis, based on decoding the audio object and parsing the metadata associated with the audio object.
