Snap inc. (20240282066). MESSAGING SYSTEM WITH NEURAL HAIR RENDERING simplified abstract
Contents
MESSAGING SYSTEM WITH NEURAL HAIR RENDERING
Organization Name
Inventor(s)
Artem Bondich of Marina del Rey CA (US)
Menglei Chai of Los Angeles CA (US)
Olekssandr Pyshchenko of Pacific Palisades CA (US)
Jian Ren of Marina Del Ray CA (US)
Sergey Tulyakov of Santa Monica CA (US)
MESSAGING SYSTEM WITH NEURAL HAIR RENDERING - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240282066 titled 'MESSAGING SYSTEM WITH NEURAL HAIR RENDERING
The messaging system described in the patent application utilizes neural network technology to render hair in images provided by users.
- Processing a 3D model of fake hair and a real hair image to generate a fake hair structure.
- Encoding the fake hair structure to generate a coded fake hair structure using a fake hair encoder neural subnetwork.
- Processing the coded fake hair structure to generate a fake and real hair structure using a cross-domain structure embedding neural subnetwork.
- Encoding a second real hair image to generate an appearance map using an appearance encoder neural subnetwork.
- Processing the appearance map and the fake and real hair structure to generate a synthesized real image using a real appearance renderer neural subnetwork.
Potential Applications: - Image editing software - Virtual reality applications - Augmented reality filters
Problems Solved: - Realistic hair rendering in images - Enhancing user experience in messaging systems
Benefits: - Improved visual quality in images - Enhanced creativity in image editing - Personalized messaging experience
Commercial Applications: Title: Advanced Image Editing Technology for Messaging Systems This technology can be used in image editing software, virtual reality applications, and augmented reality filters, enhancing user experience and visual quality in various industries.
Questions about the technology: 1. How does the neural network technology improve hair rendering in images? 2. What are the potential commercial uses of this advanced image editing technology?
Original Abstract Submitted
a messaging system performs neural network hair rendering for images provided by users of the messaging system. a method of neural network hair rendering includes processing a three-dimensional (3d) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. the method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. the method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.
