Snap inc. (20250095308). DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
Organization Name
Inventor(s)
Matan Zohar of Rishon LeZion IL
DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
This abstract first appeared for US patent application 20250095308 titled 'DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
Original Abstract Submitted
methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3d) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining uv positions of the real-world object depicted in the video to obtain pixel values associated with the uv positions; generating an external mesh and associated augmented reality (ar) element representing the real-world object based on the pixel values associated with the uv positions; deforming the external mesh based on changes to the 3d body mesh and a deformation parameter; and modifying the video to replace the real-world object with the ar element based on the deformed external mesh.