Apple inc. (20240098234). Head-Mounted Electronic Device with Reliable Passthrough Video Fallback Capability simplified abstract

Head-Mounted Electronic Device with Reliable Passthrough Video Fallback Capability

Organization Name

apple inc.

Inventor(s)

Michael C Friedman of Nederland CO (US)

Russell L Jones of Westminster CO (US)

Kaushik Raghunath of Pleasanton CA (US)

Venu M Duggineni of San Jose CA (US)

Ranjit Desai of Cupertino CA (US)

Manjunath M Venkatesh of San Fransisco CA (US)

Michael J Rockwell of Palo Alto CA (US)

Arun Kannan of Mountain View CA (US)

Saul H Weiss of Parker CO (US)

Head-Mounted Electronic Device with Reliable Passthrough Video Fallback Capability - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240098234 titled 'Head-Mounted Electronic Device with Reliable Passthrough Video Fallback Capability

Simplified Explanation

The abstract describes a head-mounted device with cameras and displays that can generate a passthrough video feed by processing raw video using image signal processors and auxiliary compute blocks. The device can bypass faulty compute blocks to maintain a reliable video feed without needing to restart.

• The head-mounted device includes cameras for acquiring raw video and displays for presenting a passthrough video feed to the user.
• Processing of the raw video feed involves image signal processors and auxiliary compute blocks.
• Faulty compute blocks can be bypassed to ensure a reliable passthrough video feed without the need for a power cycle.

Potential Applications

The technology could be used in augmented reality (AR) devices, virtual reality (VR) headsets, and other wearable displays.

Problems Solved

The innovation addresses the issue of maintaining a reliable video feed in head-mounted devices without the need for a complete restart.

Benefits

The device provides a seamless user experience by automatically switching to a more reliable video feed in case of compute block failures.

Potential Commercial Applications

This technology could be valuable in industries such as gaming, healthcare, education, and remote assistance.

Possible Prior Art

Prior art may include similar systems used in AR and VR devices, but the specific method of bypassing faulty compute blocks to maintain a reliable video feed may be novel.

How does the device detect failures in the auxiliary compute blocks?

The abstract does not specify the method used to detect failures in the auxiliary compute blocks. This information would be crucial in understanding the device's reliability and fault tolerance mechanisms.

What is the impact of bypassing faulty compute blocks on the overall performance of the device?

It is not clear from the abstract how bypassing faulty compute blocks affects the performance of the head-mounted device. Understanding this impact would be essential for evaluating the effectiveness of the technology in real-world applications.

Original Abstract Submitted

a head-mounted device is provided that includes one or more cameras configured to acquire a raw video feed and one or more displays configured to present a passthrough video feed to a user. generation of the passthrough video feed can involve processing the raw video feed using an image signal processor and auxiliary compute blocks. one or more of the auxiliary compute blocks can be bypassed in response to detecting one or more failures associated with the auxiliary compute blocks. configured and operated in this way, the head-mounted device can fall back to a more reliable passthrough video feed without having to power cycle the head-mounted device when a failure occurs.