View source for Tencent Technology (Shenzhen) Company Limited (20240282033). GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE simplified abstract

=GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE=


==Organization Name==

[[:Category:Tencent Technology  (Shenzhen) Company Limited|Tencent Technology  (Shenzhen) Company Limited]]


[[Category:Tencent Technology  (Shenzhen) Company Limited]]

==Inventor(s)==

[[:Category:Guinan Su of Shenzhen (CN)|Guinan Su of Shenzhen (CN)]][[Category:Guinan Su of Shenzhen (CN)]]

[[:Category:Gao Wu of Shenzhen (CN)|Gao Wu of Shenzhen (CN)]][[Category:Gao Wu of Shenzhen (CN)]]

[[:Category:Zhifeng Li of Shenzhen (CN)|Zhifeng Li of Shenzhen (CN)]][[Category:Zhifeng Li of Shenzhen (CN)]]

[[:Category:Wei Liu of Shenzhen (CN)|Wei Liu of Shenzhen (CN)]][[Category:Wei Liu of Shenzhen (CN)]]

[[:Category:Yushi Cui of Shenzhen (CN)|Yushi Cui of Shenzhen (CN)]][[Category:Yushi Cui of Shenzhen (CN)]]

==GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE - A simplified explanation of the abstract==


This abstract first appeared for US patent application 20240282033 titled 'GENERATING IMAGE DATA OF A VIRTUAL OBJECT BASED ON A FUSED AUDIO FEATURE

The abstract of the patent application describes a method for generating videos using audio data and initial image data of a virtual object. This method involves extracting audio features, encoding vocal channel characteristics, fusing audio and encoded features, and updating image data based on the fused audio feature to create video data.

* Obtaining audio data and initial image data of a virtual object
* Extracting audio features and encoding vocal channel characteristics
* Fusing audio and encoded features to create a fused audio feature
* Generating updated image data of the virtual object based on the fused audio feature
* Creating video data including the updated image data and the audio data

Potential Applications:
- Entertainment industry for creating interactive and dynamic videos
- Virtual reality and augmented reality applications for enhanced user experiences
- Educational tools for visualizing audio concepts in a more engaging way

Problems Solved:
- Enhances the synchronization of audio and visual elements in videos
- Allows for more immersive and interactive content creation
- Improves the overall quality and engagement of video content

Benefits:
- Increased user engagement and retention
- Enhanced storytelling capabilities
- Improved audio-visual synchronization

Commercial Applications:
"Dynamic Video Generation Method for Enhanced User Engagement in Entertainment and Education"

Questions about the technology:
1. How does this method improve the overall quality of video content?
2. What are the potential implications of this technology in the entertainment industry?

Frequently Updated Research:
Stay updated on advancements in audio-visual synchronization technologies and virtual reality applications for video content creation.


==Original Abstract Submitted==

a video generation method includes obtaining audio data and initial image data of a virtual object, extracting an audio feature from the audio data, and performing predictive encoding on the audio data to obtain an encoded feature representing vocal channel characteristics of the audio data. the method further includes fusing the audio feature and the encoded feature to obtain a fused audio feature, and generating updated image data of the virtual object according to the fused audio feature and the initial image data. the method further includes generating video data including the updated image data and the audio data



[[Category:G06T13/20]]
[[Category:G06T13/40]]
[[Category:G10L15/18]]
[[Category:G10L25/24]]
[[Category:G10L25/75]]
[[Category:CPC_G06T13/205]]