18677296. VISUAL-INERTIAL TRACKING USING ROLLING SHUTTER CAMERAS simplified abstract (Snap Inc.)
Contents
VISUAL-INERTIAL TRACKING USING ROLLING SHUTTER CAMERAS
Organization Name
Inventor(s)
Matthias Kalkgruber of Vienna (AT)
Erick Mendez Mendez of Vienna (AT)
VISUAL-INERTIAL TRACKING USING ROLLING SHUTTER CAMERAS - A simplified explanation of the abstract
This abstract first appeared for US patent application 18677296 titled 'VISUAL-INERTIAL TRACKING USING ROLLING SHUTTER CAMERAS
Simplified Explanation: The patent application describes a method for visual-inertial tracking of an eyewear device using a rolling shutter camera. This involves determining the position of the device by sensing its motion and capturing images of the environment to compute poses for the camera based on the device's movement.
Key Features and Innovation:
- Visual-inertial tracking of an eyewear device using a rolling shutter camera.
- Determining the device's position by sensing its motion.
- Computing poses for the camera based on the device's movement.
- Matching feature points in captured images to computed poses for accurate tracking.
- Responsive number of computed poses based on the device's movement.
Potential Applications: This technology can be used in augmented reality applications, indoor navigation systems, and virtual reality experiences where accurate tracking of a mobile device is crucial.
Problems Solved: The technology addresses the challenge of accurately tracking the position of a mobile device in real-time using visual and inertial sensors, especially in dynamic environments.
Benefits:
- Improved accuracy in tracking the position of a mobile device.
- Enhanced user experience in augmented reality and virtual reality applications.
- Seamless integration of visual and inertial sensors for precise tracking.
Commercial Applications: Potential commercial applications include AR glasses, VR headsets, indoor navigation systems for shopping malls or museums, and gaming devices that require accurate motion tracking.
Prior Art: Readers can explore prior research on visual-inertial tracking systems, rolling shutter cameras, and sensor fusion techniques in the field of computer vision and augmented reality.
Frequently Updated Research: Stay updated on advancements in visual-inertial tracking technology, sensor fusion algorithms, and applications of rolling shutter cameras in mobile devices.
Questions about Visual-Inertial Tracking: 1. How does visual-inertial tracking differ from traditional GPS-based tracking systems? 2. What are the main challenges in implementing visual-inertial tracking for mobile devices?
1. A relevant generic question not answered by the article, with a detailed answer. 2. Another relevant generic question, with a detailed answer.
Original Abstract Submitted
Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
