20240015466. SYSTEM AND METHOD FOR GENERATING SPATIAL AUDIO WITH UNIFORM REVERBERATION IN REAL-TIME COMMUNICATION simplified abstract (Agora Lab, Inc.)
SYSTEM AND METHOD FOR GENERATING SPATIAL AUDIO WITH UNIFORM REVERBERATION IN REAL-TIME COMMUNICATION
Organization Name
Inventor(s)
Jianyuan Feng of Shanghai (CN)
SYSTEM AND METHOD FOR GENERATING SPATIAL AUDIO WITH UNIFORM REVERBERATION IN REAL-TIME COMMUNICATION - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240015466 titled 'SYSTEM AND METHOD FOR GENERATING SPATIAL AUDIO WITH UNIFORM REVERBERATION IN REAL-TIME COMMUNICATION
Simplified Explanation
The abstract describes a computer-implemented method for generating spatial audio with uniform reverberation in a real-time communication session. The method involves removing the reverberation from recorded speech signals, rendering the direct sound parts using head-related transfer functions, generating reverberant sound parts by convolving the output signals with uniform room impulse responses or an artificial reverberator, and combining the direct and reverberant sound components to generate spatialized speech signals. In the case of virtual conference rooms, where speakers and listeners are located in two separate rooms, the reverberation of the two rooms is coupled.
- The method removes reverberation from recorded speech signals.
- The direct sound parts are rendered using head-related transfer functions.
- Reverberant sound parts are generated by convolving the output signals with uniform room impulse responses or an artificial reverberator.
- The direct and reverberant sound components are combined to generate spatialized speech signals.
- In the case of virtual conference rooms, the reverberation of the two rooms is coupled.
Potential applications of this technology:
- Real-time communication software applications that require spatial audio with uniform reverberation.
- Virtual conference rooms or virtual meeting platforms where participants can experience realistic spatial audio.
Problems solved by this technology:
- Eliminates the reverberation from recorded speech signals, improving the clarity and intelligibility of the audio.
- Provides a realistic and immersive audio experience in virtual conference rooms or virtual meeting platforms.
Benefits of this technology:
- Improved audio quality and intelligibility in real-time communication sessions.
- Enhanced user experience in virtual conference rooms or virtual meeting platforms.
- More effective communication and collaboration in remote settings.
Original Abstract Submitted
a computer-implemented method for generating spatial audio with uniform reverberation in a real-time communication session is performed by a real-time communication software application running on an electronic communication device. the method includes removing the reverberation of recorded speech signals from far-end participants by the dereverberation approach, rendering the direct sound parts by filtering the output signals by head-related transfer functions of desired directions, generating reverberant sound parts by convolving the output signals from with uniform room impulse responses or an artificial reverberator, combining direct and reverberant sound components to generate spatialized speech signals. when speakers and listeners are located in two virtual conference rooms, the reverberation of the two rooms are coupled. the reverberant sound parts are then generated by convolving the output signals and coupled rirs from the two rooms.
