18969689. DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH (Snap Inc.)
DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
Organization Name
Inventor(s)
Matan Zohar of Rishon LeZion IL
DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
This abstract first appeared for US patent application 18969689 titled 'DEFORMING REAL-WORLD OBJECT USING AN EXTERNAL MESH
Original Abstract Submitted
Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.
