RELIGHTABLE AND REANIMATABLE NEURAL HEADS

Abstract: the present invention sets forth techniques for generating an animation sequence. the techniques include receiving one or more three-dimensional (3d) input meshes, wherein each input mesh includes a representation of an object included in a 3d scene. the techniques also include receiving, for each of the 3d input meshes, a virtual camera position associated with the 3d input mesh and one or more virtual lighting positions associated with the 3d input mesh. the techniques further include generating, for each of the 3d input meshes and via a trained machine learning model, one or more rendered frames associated with the 3d input mesh, wherein each rendered frame includes a two-dimensional (2d) representation of the object as viewed from the virtual camera position and illuminated by one or more virtual lights located at the one or more virtual lighting positions, and generating an output animation sequence based on the rendered frames.

Inventor(s): Derek Edward BRADLEY, Prashanth CHANDRAN, Sebastian Klaus WEISS, Yingyan XU, Gaspard ZOSS

CPC Classification: G06T13/40 (of characters, e.g. humans, animals or virtual beings)

Search for rejections for patent application number 20250166273