SYSTEMS AND METHODS FOR GESTURE GENERATION

Abstract: embodiments described herein include a hybrid gesture generation model using a sentence encoder. by using a pre-trained model as the sentence encoder, the framework may output an embedding for a sentence containing any word, even if it is not in the training set, further, embodiments described herein include a hybrid gesture model that combines trained co-speech gesture generation with a retrieval of pre-defined special gestures. the generation part uses text input to a model trained with co-speech gesture data. the retrieval part uses pre-defined gestures for six different situations that have been prepared in advance. using embodiments described herein, an ai avatar can perform special gestures like greeting or shaking hands in predefined specific situations, and co-speech gestures in other conversational situations.

Inventor(s): Seonghyeok Noh, Hanseok Ko, Bonhwa Ku

CPC Classification: G06T13/40 (of characters, e.g. humans, animals or virtual beings)

Search for rejections for patent application number 20250166274