US Patent Application 18247212. SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE simplified abstract

From WikiPatents
Jump to navigation Jump to search

SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE

Organization Name

Huawei Technologies Co., Ltd.==Inventor(s)==

[[Category:Guangzhao Bao of Shanghai (CN)]]

[[Category:Liwen Chen of Shanghai (CN)]]

[[Category:Lei Huang of Shanghai (CN)]]

SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE - A simplified explanation of the abstract

This abstract first appeared for US patent application 18247212 titled 'SIGNAL PROCESSING METHOD AND ELECTRONIC DEVICE

Simplified Explanation

The patent application describes signal processing methods and electronic devices that utilize a microphone array and a camera.

  • The methods involve performing sound source localization to determine the direction of a sound source using the microphone array.
  • The camera is used to process a video and obtain user direction information.
  • The sound source direction information and user direction information are used to determine a target sound source direction.
  • The camera is then used to obtain a video of the user's lips in the target sound source direction.
  • An audio signal is obtained using the microphone array, and a third audio signal is generated using a voice quality enhancement model and the user lip video.


Original Abstract Submitted

Example signal processing methods and example electronic devices are disclosed. One example method is applied to an electronic device, where the electronic device includes a microphone array and a camera. The example method includes performing sound source localization on a first audio signal obtained by using the microphone array, to obtain sound source direction information. A first video obtained by using the camera is processed to obtain user direction information. A target sound source direction is determined based on the sound source direction information and the user direction information. A user lip video is obtained in the target sound source direction by using the camera. A second audio signal is obtained by using the microphone array. A third audio signal is obtained based on the second audio signal and the user lip video by using a voice quality enhancement model.