Snap inc. (20240323516). MULTI-PURPOSE CAMERAS FOR SIMULTANEOUS CAPTURE AND CV ON WEARABLE AR DEVICES simplified abstract
Contents
MULTI-PURPOSE CAMERAS FOR SIMULTANEOUS CAPTURE AND CV ON WEARABLE AR DEVICES
Organization Name
Inventor(s)
Bo Ding of Los Angeles CA (US)
Chintan Doshi of Marina Del Rey CA (US)
John James Robertson of Los Angeles CA (US)
Dmitry Ryuma of Sherman Oaks CA (US)
MULTI-PURPOSE CAMERAS FOR SIMULTANEOUS CAPTURE AND CV ON WEARABLE AR DEVICES - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240323516 titled 'MULTI-PURPOSE CAMERAS FOR SIMULTANEOUS CAPTURE AND CV ON WEARABLE AR DEVICES
Simplified Explanation: The patent application describes eyewear with an image signal processor (ISP) that can switch between augmented reality (AR) and computer vision (CV) modes to capture images at different resolutions.
- Cameras on the eyewear capture images in high resolution for AR mode and lower resolution for CV mode.
- The ISP and cameras consume less power in CV mode, saving significant system power.
- The technology allows for simultaneous image capture and CV processing on wearable AR devices.
Key Features and Innovation:
- Dynamic operation of an ISP in a camera pipeline for AR and CV systems.
- Multi-purpose cameras for image capture and CV on wearable AR devices.
- Switching between AR and CV modes to optimize resolution and power consumption.
Potential Applications:
- Augmented reality applications in gaming, navigation, and education.
- Computer vision applications in object recognition, facial recognition, and autonomous vehicles.
Problems Solved:
- Power consumption optimization in AR and CV systems.
- Simultaneous image capture and CV processing on wearable devices.
Benefits:
- Enhanced user experience with high-resolution AR images.
- Improved efficiency with lower power consumption in CV mode.
Commercial Applications: Augmented reality glasses for gaming, navigation, and industrial applications.
Questions about Eyewear with ISP for AR and CV Systems: 1. How does the ISP switch between AR and CV modes? 2. What are the potential challenges in implementing this technology on a large scale?
Frequently Updated Research: Stay updated on advancements in AR and CV technologies for wearable devices.
Original Abstract Submitted
eyewear having an image signal processor (isp) dynamically operable in a camera pipeline for augmented reality (ar) and computer vision (cv) systems. multi-purpose cameras are used for simultaneous image capture and cv on wearable ar devices. the cameras are coupled to a frame and configured to generate images, wherein the cameras and the isp operate in a first ar mode and capture images having a first resolution suitable for use in ar, and are configured to operate in a second cv mode to provide the images having a second resolution suitable for use in cv. the first resolution in the ar mode is higher than the second resolution in the cv mode, and the cameras and the isp consume less power in the second cv mode than the first ar mode. the cameras and the isp save significant system power by operating in the low power mode cv mode.
