Tencent Technology (Shenzhen) Company Limited (20240282033). GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE simplified abstract
Contents
GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE
Organization Name
Tencent Technology (Shenzhen) Company Limited
Inventor(s)
GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240282033 titled 'GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE
The abstract of the patent application describes a method for generating videos using audio data and initial image data of a virtual object. This method involves extracting audio features, encoding vocal channel characteristics, fusing audio and encoded features, and updating image data based on the fused audio feature to create video data.
- Obtaining audio data and initial image data of a virtual object
- Extracting audio features and encoding vocal channel characteristics
- Fusing audio and encoded features to create a fused audio feature
- Generating updated image data of the virtual object based on the fused audio feature
- Creating video data including the updated image data and the audio data
Potential Applications: - Entertainment industry for creating interactive and dynamic videos - Virtual reality and augmented reality applications for enhanced user experiences - Educational tools for visualizing audio concepts in a more engaging way
Problems Solved: - Enhances the synchronization of audio and visual elements in videos - Allows for more immersive and interactive content creation - Improves the overall quality and engagement of video content
Benefits: - Increased user engagement and retention - Enhanced storytelling capabilities - Improved audio-visual synchronization
Commercial Applications: "Dynamic Video Generation Method for Enhanced User Engagement in Entertainment and Education"
Questions about the technology: 1. How does this method improve the overall quality of video content? 2. What are the potential implications of this technology in the entertainment industry?
Frequently Updated Research: Stay updated on advancements in audio-visual synchronization technologies and virtual reality applications for video content creation.
Original Abstract Submitted
a video generation method includes obtaining audio data and initial image data of a virtual object, extracting an audio feature from the audio data, and performing predictive encoding on the audio data to obtain an encoded feature representing vocal channel characteristics of the audio data. the method further includes fusing the audio feature and the encoded feature to obtain a fused audio feature, and generating updated image data of the virtual object according to the fused audio feature and the initial image data. the method further includes generating video data including the updated image data and the audio data
