18609050. DIFFUSION BASED CLOTH REGISTRATION simplified abstract (Meta Platforms Technologies, LLC)

DIFFUSION BASED CLOTH REGISTRATION

Organization Name

Meta Platforms Technologies, LLC

Inventor(s)

Shunsuke Saito of Pittsburgh PA (US)

Jingfan Guo of Minneapolis MN (US)

Chenglei Wu of Pittsburgh PA (US)

Fabian Andres Prada of Pittsburgh PA (US)

Donglai Xiang of Pittsburgh PA (US)

Javier Romero of Madrid (ES)

Takaaki Shiratori of Pittsburgh PA (US)

Hyun Soo Park of St. Paul MN (US)

DIFFUSION BASED CLOTH REGISTRATION - A simplified explanation of the abstract

This abstract first appeared for US patent application 18609050 titled 'DIFFUSION BASED CLOTH REGISTRATION

Simplified Explanation:

This patent application describes a method and system for improving the modeling of clothes by accurately registering cloth, including wrinkles, based on input scans of clothing in motion.

• The method involves generating a mesh representing the cloth in the scan using a diffusion-based shape prior.
• The system registers a model of the cloth from the scan by guiding the deformation of the clothing based on a coarse registration signal and the distance between points in the mesh and a template mesh.

Key Features and Innovation:

• Accurate cloth registration for improved clothing modeling.
• Utilization of diffusion-based shape prior for generating cloth mesh.
• Guidance process for registering cloth model based on coarse registration signal and distance between points in the mesh and a template mesh.

Potential Applications:

• Fashion design and clothing manufacturing.
• Virtual try-on applications for online shopping.
• Animation and special effects in the entertainment industry.

Problems Solved:

• Inaccurate cloth modeling in virtual environments.
• Difficulty in capturing realistic cloth wrinkles in motion.
• Lack of efficient cloth registration methods.

Benefits:

• Enhanced realism in virtual clothing simulations.
• Improved accuracy in cloth modeling.
• Streamlined clothing design processes.

Commercial Applications:

Clothing design software for fashion industry professionals, Virtual try-on solutions for e-commerce platforms, Animation software for film and gaming industries.

Questions about Cloth Registration Technology:

1. How does the guidance process improve the accuracy of cloth registration in the modeling process? 2. What are the potential limitations of using a diffusion-based shape prior for generating cloth meshes?

Original Abstract Submitted

A method and system for cloth registration to improve modeling clothes by providing, for example, wrinkle-accurate cloth registration. The method includes obtaining an input scan of clothing in motion. The method includes generating a mesh representing the cloth in the scan based on a diffusion-based shape prior. The method includes registering a model of the cloth from the scan using a guidance process including at least: guiding deformation of the clothing based on a coarse registration signal based on the mesh and guiding the deformation of the clothing based on a distance between points in the mesh and a template mesh.