Snap inc. (20240257484). 3D UPPER GARMENT TRACKING simplified abstract
Contents
3D UPPER GARMENT TRACKING
Organization Name
Inventor(s)
Itamar Berger of Hod Hasharon (IL)
Gal Dudovitch of Tel Aviv (IL)
Gal Sasson of Kibbutz Ayyelet Hashahar (IL)
Ma'ayan Shuvi of Tel Aviv (IL)
Matan Zohar of Rishon LeZion (IL)
3D UPPER GARMENT TRACKING - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240257484 titled '3D UPPER GARMENT TRACKING
The abstract of the patent application describes a method and system for manipulating augmented reality elements on a fashion item worn by a person in a video.
- Receiving a video featuring a person wearing a fashion item
- Generating a 3D model of the person in the video
- Creating a segmentation of the fashion item worn by the person
- Outlining a portion of the 3D model based on the segmentation of the fashion item
- Tracking the movement of the outlined portion in the video
- Modifying the display position of augmented reality elements on the fashion item based on the tracked movement
Potential Applications: - Virtual try-on experiences for online shopping - Interactive fashion shows and presentations - Enhanced social media filters and effects
Problems Solved: - Improving the accuracy and realism of augmented reality elements on fashion items in videos - Enhancing user engagement and interactivity in virtual fashion experiences
Benefits: - Personalized and immersive shopping experiences - Increased user interaction and engagement with digital content - Enhanced visual representation of fashion items in videos
Commercial Applications: - Fashion e-commerce platforms - Virtual fashion events and showcases - Social media and digital marketing campaigns
Questions about the technology: 1. How does this technology improve the user experience in online shopping? 2. What are the potential challenges in implementing augmented reality elements on fashion items in videos?
Original Abstract Submitted
methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3d) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3d model based on the segmentation of the fashion item; tracking movement of the portion of the 3d model in the video; and in response to tracking the movement of the portion of the 3d model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.