Tencent Technology (Shenzhen) Company Limited (20240257554). IMAGE GENERATION METHOD AND RELATED DEVICE simplified abstract
Contents
IMAGE GENERATION METHOD AND RELATED DEVICE
Organization Name
Tencent Technology (Shenzhen) Company Limited
Inventor(s)
Chengjie Wang of Shenzhen (CN)
IMAGE GENERATION METHOD AND RELATED DEVICE - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240257554 titled 'IMAGE GENERATION METHOD AND RELATED DEVICE
Simplified Explanation: The patent application describes a method for generating images using an electronic device, involving analyzing face images, audio data, and emotional cues to create a new face image with adjusted features.
- **Spatial Feature Extraction:** Extracting spatial features from the original face image.
- **Feature Interaction Processing:** Analyzing audio and emotion data to determine local pose features of the face.
- **Face Reconstruction Processing:** Using the original spatial features and local pose features to reconstruct a new face image.
Key Features and Innovation:
- Integration of audio and emotion data to adjust facial features.
- Utilization of spatial and pose features for accurate face reconstruction.
Potential Applications:
- Virtual reality applications.
- Entertainment industry for creating realistic avatars.
- Facial recognition technology for security systems.
Problems Solved:
- Enhancing image generation accuracy.
- Improving emotional expression in generated faces.
Benefits:
- Enhanced realism in generated images.
- Increased customization options for users.
Commercial Applications: The technology can be used in industries such as virtual reality, entertainment, and security systems to create realistic and emotionally expressive images.
Questions about Image Generation: 1. How does the method ensure accuracy in reconstructing facial features based on audio and emotion data? 2. What are the potential limitations of using this technology in real-time applications?
Frequently Updated Research: Stay updated on advancements in facial recognition technology and image generation techniques to enhance the capabilities of this method.
Original Abstract Submitted
an image generation method, performed by an electronic device includes obtaining an original face image frame, audio driving information, and emotion driving information, performing spatial feature extraction on the original face image frame to obtain an original face spatial feature corresponding to the original face image frame; performing feature interaction processing on the audio driving information and the emotion driving information to obtain a face local pose feature of the to-be-adjusted object issuing the voice content with the target emotion; and performing, based on the original face spatial feature and the face local pose feature, face reconstruction processing on the to-be-adjusted object to generate a target face image frame.
