Loop Now Technologies, Inc. (20240292069). SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO simplified abstract
Contents
SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO
Organization Name
Inventor(s)
Hong-Ming Tseng of Toronto (CA)
Edwin Chiu of Cupertino CA (US)
Wu-Hsi Li of Somerville MA (US)
Jeremiah Kevin Tu of Sunnyvale CA (US)
SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240292069 titled 'SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO
The disclosed embodiments provide techniques for creating realistic metahuman short-form videos using photorealistic representations of individuals sourced from various media. These representations are isolated using machine learning and used to generate a 3D model of the individual, which is then animated to create a synthetic performance. This performance, which may include the voice of the human host, is inserted into a metaverse environment and rendered as a short-form video with an ecommerce window.
- Photorealistic representations of individuals sourced from videos, photographs, livestreams, or 360-degree recordings are used to create realistic metahuman short-form videos.
- Machine learning is employed to isolate the photorealistic representation and generate a 3D model of the individual.
- The 3D model is animated using a game engine to create a synthetic performance, which can include the voice of the human host.
- The synthetic performance is inserted into a metaverse environment and rendered as a short-form video with an ecommerce window for virtual shopping.
- Potential Applications:
This technology could be used in entertainment, advertising, virtual events, and virtual shopping experiences.
- Problems Solved:
This technology addresses the need for realistic and engaging virtual content creation, as well as personalized advertising and shopping experiences.
- Benefits:
The benefits of this technology include enhanced viewer engagement, personalized advertising, and immersive virtual shopping experiences.
- Commercial Applications:
"Realistic Metahuman Short-Form Video Synthesis Technology for Virtual Shopping Experiences"
- Questions about Realistic Metahuman Short-Form Video Synthesis Technology:
1. How does this technology impact the future of virtual content creation? 2. What are the potential ethical considerations surrounding the use of photorealistic representations in virtual environments?
- Prior Art:
Further research can be conducted in the fields of virtual reality, augmented reality, and computer graphics to explore prior art related to this technology.
- Frequently Updated Research:
Stay updated on advancements in machine learning, 3D modeling, animation, and virtual reality technologies relevant to this innovation.
Original Abstract Submitted
disclosed embodiments provide techniques for synthesized realistic metahuman short-form videos. a photorealistic representation of an individual is accessed from media sources including videos, photographs, livestreams, or a 360-degree recording of a human host. the individual can be selected based on information on the viewer of the short-form video, such as purchase history, viewing history, and metadata. the photorealistic representation is isolated using machine learning and is used to create a three-dimensional (3d) model of the individual, based on a game engine. a realistic synthetic performance is created by combining the 3d model of the individual with animation generated by a game engine. the synthesized performance can include the voice of the human host. the synthesized performance is inserted into a metaverse environment and rendered to a viewer as a short-form video, including an ecommerce window with an on-screen product card and virtual purchase cart.