18624757. REAL-TIME TRACKING-COMPENSATED IMAGE EFFECTS simplified abstract (Snap Inc.)

REAL-TIME TRACKING-COMPENSATED IMAGE EFFECTS

Organization Name

Snap Inc.

Inventor(s)

Samuel Edward Hare of Los Angeles CA (US)

Fedir Poliakov of Marina Del Rey CA (US)

Guohui Wang of Long Angeles CA (US)

Xuehan Xiong of Los Angeles CA (US)

Jianchao Yang of Los Angeles CA (US)

Linjie Yang of Los Angeles CA (US)

Shah Tanmay Anilkumar of Los Angeles CA (US)

REAL-TIME TRACKING-COMPENSATED IMAGE EFFECTS - A simplified explanation of the abstract

This abstract first appeared for US patent application 18624757 titled 'REAL-TIME TRACKING-COMPENSATED IMAGE EFFECTS

Simplified Explanation

A mobile device can create complex visual effects in real-time by using two processing pipelines: one for applying complex image processes to keyframes and another for generating flow maps to process non-keyframes on the fly.

• The first pipeline applies complex image processes, such as neural networks, to keyframes of a live image sequence.
• The second pipeline generates flow maps that describe feature transformations in the image sequence.
• Flow maps are used to process non-keyframes in real-time.
• The processed keyframes and non-keyframes are used to display complex visual effects on the mobile device in real-time or near real-time.

Key Features and Innovation

• Utilizes two processing pipelines for real-time complex visual effects.
• Applies complex image processes, such as neural networks, to keyframes.
• Generates flow maps to describe feature transformations in the image sequence.
• Processes non-keyframes on the fly using flow maps.
• Displays complex visual effects on the mobile device in real-time or near real-time.

Potential Applications

This technology can be used in:

• Mobile gaming for enhanced visual effects.
• Augmented reality applications for immersive experiences.
• Video editing software for real-time effects.
• Virtual reality environments for interactive visuals.
• Live streaming platforms for dynamic overlays.

Problems Solved

• Enables real-time generation of complex visual effects on mobile devices.
• Improves the quality and interactivity of visual content.
• Enhances user experience in gaming, AR, VR, video editing, and live streaming.

Benefits

• Real-time or near real-time display of complex visual effects.
• Enhanced user engagement and immersion.
• Improved quality and interactivity of visual content.
• Versatile applications across various industries.

Commercial Applications

• "Real-Time Complex Visual Effects Generation on Mobile Devices" can revolutionize the mobile gaming industry by offering enhanced visual experiences to gamers. This technology can also be utilized in augmented reality applications, video editing software, virtual reality environments, and live streaming platforms to provide users with dynamic and interactive visual content.

Questions about Real-Time Complex Visual Effects Generation on Mobile Devices

How does this technology impact the gaming industry?

This technology can significantly enhance the visual experience for gamers by providing real-time complex visual effects on mobile devices, leading to more immersive gameplay.

What are the potential applications of this technology beyond gaming?

Apart from gaming, this technology can be utilized in augmented reality applications, video editing software, virtual reality environments, and live streaming platforms to enhance visual content and user engagement.

Original Abstract Submitted

A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.