US Patent Application 18247212. SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE simplified abstract
Contents
SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE
Organization Name
Huawei Technologies Co., Ltd.==Inventor(s)==
[[Category:Guangzhao Bao of Shanghai (CN)]]
[[Category:Liwen Chen of Shanghai (CN)]]
[[Category:Lei Huang of Shanghai (CN)]]
SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE - A simplified explanation of the abstract
This abstract first appeared for US patent application 18247212 titled 'SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE
Simplified Explanation
The patent application describes signal processing methods and electronic devices that utilize a microphone array and a camera.
- The methods involve performing sound source localization to determine the direction of a sound source using the microphone array.
- The camera is used to process a video and obtain user direction information.
- The sound source direction information and user direction information are used to determine a target sound source direction.
- The camera is then used to obtain a video of the user's lips in the target sound source direction.
- An audio signal is obtained using the microphone array, and a third audio signal is generated using a voice quality enhancement model and the user lip video.
Original Abstract Submitted
Example signal processing methods and example electronic devices are disclosed. One example method is applied to an electronic device, where the electronic device includes a microphone array and a camera. The example method includes performing sound source localization on a first audio signal obtained by using the microphone array, to obtain sound source direction information. A first video obtained by using the camera is processed to obtain user direction information. A target sound source direction is determined based on the sound source direction information and the user direction information. A user lip video is obtained in the target sound source direction by using the camera. A second audio signal is obtained by using the microphone array. A third audio signal is obtained based on the second audio signal and the user lip video by using a voice quality enhancement model.