Hangzhou Meari Technology Co.,Ltd. (20240221764). SOUND DETECTION METHOD AND RELATED DEVICE simplified abstract
SOUND DETECTION METHOD AND RELATED DEVICE
Organization Name
Hangzhou Meari Technology Co.,Ltd.
Inventor(s)
Gangqiang Zhao of Hangzhou (CN)
SOUND DETECTION METHOD AND RELATED DEVICE - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240221764 titled 'SOUND DETECTION METHOD AND RELATED DEVICE
The present application discloses a sound detection method and apparatus, an electronic device, and a computer-readable storage medium. The method involves acquiring audio and video data about a target object, extracting audio data and image data from the acquired data, performing feature extraction on the audio and image data to obtain audio and image features, inputting these features into a sound source positioning model, and identifying the sound source positioning image and audio feature using a multi-modal feature fusion model to determine the presence of target audio in the data.
- Acquiring audio and video data about a target object
- Extracting audio data and image data from the acquired data
- Performing feature extraction on the audio and image data to obtain audio and image features
- Inputting the features into a sound source positioning model
- Identifying the sound source positioning image and audio feature using a multi-modal feature fusion model
Potential Applications: - Surveillance systems - Security systems - Audio recording devices - Multimedia editing software
Problems Solved: - Efficient sound detection in audio and video data - Accurate identification of target audio in complex environments
Benefits: - Improved security measures - Enhanced audio recording capabilities - Streamlined multimedia editing processes
Commercial Applications: Title: Advanced Sound Detection Technology for Enhanced Security Systems This technology can be utilized in surveillance systems, security cameras, audio recording devices, and multimedia editing software to enhance sound detection capabilities, improving overall security measures and audio recording accuracy in various commercial applications.
Questions about Sound Detection Technology: 1. How does this technology improve sound detection in complex environments? - This technology utilizes a multi-modal feature fusion model to accurately identify target audio in audio and video data, enhancing sound detection capabilities in challenging environments. 2. What are the potential applications of this sound detection technology in commercial settings? - This technology can be applied in surveillance systems, security cameras, audio recording devices, and multimedia editing software to improve security measures and audio recording accuracy in various commercial applications.
Original Abstract Submitted
disclosed in the present application are a sound detection method and apparatus, an electronic device and a computer-readable storage medium. the method includes: acquiring audio and video data about a target object, and extracting and obtaining audio data and image data from the audio and video data; performing feature extraction on the audio data and the image data respectively to obtain an audio feature and an image feature; inputting the audio feature and the image feature into a sound source positioning model for processing; and, when the sound source positioning model outputs a sound source positioning image about the target object, identifying the sound source positioning image and the audio feature by using a multi-modal feature fusion model, and determining whether target audio of the target object exists in the audio and video data.