Loop Now Technologies, Inc. (20240292069). SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO simplified abstract

SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO

Organization Name

Loop Now Technologies, Inc.

Inventor(s)

Hong-Ming Tseng of Toronto (CA)

Edwin Chiu of Cupertino CA (US)

Wu-Hsi Li of Somerville MA (US)

Jeremiah Kevin Tu of Sunnyvale CA (US)

SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240292069 titled 'SYNTHESIZED REALISTIC METAHUMAN SHORT-FORM VIDEO

The disclosed embodiments provide techniques for creating realistic metahuman short-form videos using photorealistic representations of individuals sourced from various media. These representations are isolated using machine learning and used to generate a 3D model of the individual, which is then animated to create a synthetic performance. This performance, which may include the voice of the human host, is inserted into a metaverse environment and rendered as a short-form video with an ecommerce window.

• Photorealistic representations of individuals sourced from videos, photographs, livestreams, or 360-degree recordings are used to create realistic metahuman short-form videos.
• Machine learning is employed to isolate the photorealistic representation and generate a 3D model of the individual.
• The 3D model is animated using a game engine to create a synthetic performance, which can include the voice of the human host.
• The synthetic performance is inserted into a metaverse environment and rendered as a short-form video with an ecommerce window for virtual shopping.

1. 1. 1. Potential Applications:

This technology could be used in entertainment, advertising, virtual events, and virtual shopping experiences.

1. 1. 1. Problems Solved:

This technology addresses the need for realistic and engaging virtual content creation, as well as personalized advertising and shopping experiences.

1. 1. 1. Benefits:

The benefits of this technology include enhanced viewer engagement, personalized advertising, and immersive virtual shopping experiences.

1. 1. 1. Commercial Applications:

"Realistic Metahuman Short-Form Video Synthesis Technology for Virtual Shopping Experiences"

1. 1. 1. Questions about Realistic Metahuman Short-Form Video Synthesis Technology:

1. How does this technology impact the future of virtual content creation? 2. What are the potential ethical considerations surrounding the use of photorealistic representations in virtual environments?

1. 1. 1. Prior Art:

Further research can be conducted in the fields of virtual reality, augmented reality, and computer graphics to explore prior art related to this technology.

1. 1. 1. Frequently Updated Research:

Stay updated on advancements in machine learning, 3D modeling, animation, and virtual reality technologies relevant to this innovation.

Original Abstract Submitted

disclosed embodiments provide techniques for synthesized realistic metahuman short-form videos. a photorealistic representation of an individual is accessed from media sources including videos, photographs, livestreams, or a 360-degree recording of a human host. the individual can be selected based on information on the viewer of the short-form video, such as purchase history, viewing history, and metadata. the photorealistic representation is isolated using machine learning and is used to create a three-dimensional (3d) model of the individual, based on a game engine. a realistic synthetic performance is created by combining the 3d model of the individual with animation generated by a game engine. the synthesized performance can include the voice of the human host. the synthesized performance is inserted into a metaverse environment and rendered to a viewer as a short-form video, including an ecommerce window with an on-screen product card and virtual purchase cart.