18601097. Real-Time Avatar Animation (SAMSUNG ELECTRONICS CO., LTD.)
Real-Time Avatar Animation
Organization Name
Inventor(s)
Christopher Peri of Mountain View CA US
Byeonghee Yu of Berkeley CA US
Real-Time Avatar Animation
This abstract first appeared for US patent application 18601097 titled 'Real-Time Avatar Animation
Original Abstract Submitted
In one embodiment, a method includes accessing an audio input that includes a mixture of vocal sounds and non-vocal sounds and separating, by a trained audio source separation model, the audio input into a first audio output representing the vocal sounds and a second audio output representing the non-vocal sounds. The method further includes determining, by one or more trained avatar animation models and by separately encoding the first audio output representing the vocal sounds and the second audio output representing the non-vocal sounds, an avatar animation temporally corresponding to the audio input; and rendering, in real time and temporally coincident with the audio input, the determined avatar animation.