FOUR-DIMENSIONAL OBJECT AND SCENE MODEL SYNTHESIS USING GENERATIVE MODELS

Abstract: in various examples, systems and methods are disclosed relating to generation of four-dimensional (4d) content models, such as 4d content models to render realistic sequences of frames of 3d data. the systems can initialize a 3d component of the 4d content model, such as a 3d gaussian splatting representation, based at least on a prompt for the 4d content. the system can configure motion and/or dynamics for the sequence of frames by evaluating frames rendered from the 4d content model using one or more latent diffusion models (ldms), including a video ldm. the system can perform operations such as autoregressive generation of frames to create long sequences of content, motion amplification to facilitate realistic, dynamic motion generation, and regularization to facilitate generation of complex dynamics.

Inventor(s): Karsten Julian KREIS, Seung Wook KIM, Huan LING, Sanja FIDLER

CPC Classification: G06T19/00 (Manipulating 3D models or images for computer graphics)

Search for rejections for patent application number 20250182404