18135985. Video See-Through Augmented Reality simplified abstract (SAMSUNG ELECTRONICS CO., LTD.)

From WikiPatents
Jump to navigation Jump to search

Video See-Through Augmented Reality

Organization Name

SAMSUNG ELECTRONICS CO., LTD.

Inventor(s)

Yingen Xiong of Mountain View CA (US)

Video See-Through Augmented Reality - A simplified explanation of the abstract

This abstract first appeared for US patent application 18135985 titled 'Video See-Through Augmented Reality

Simplified Explanation

The patent application describes a method for calibrating and registering a video see-through augmented reality (AR) system. The method involves capturing stereo images of a calibration object and obtaining position data for each camera at the time of capture. A 3D reconstruction of the calibration object is generated. A registration process is performed using parameters of virtual cameras to generate stereo virtual views that include the calibration object. Differences between the virtual images of the calibration object and a virtual rendering of the object are determined and used to adjust the virtual-camera parameters or store them for the system.

  • The method involves capturing stereo images of a calibration object and obtaining position data for each camera.
  • A 3D reconstruction of the calibration object is generated.
  • The registration process uses virtual cameras to generate stereo virtual views that include the calibration object.
  • Differences between the virtual images and a virtual rendering of the calibration object are determined.
  • The differences are used to adjust the virtual-camera parameters or store them for the system.

Potential applications of this technology:

  • Augmented reality systems: The method can be used in video see-through AR systems to calibrate and register virtual objects with real-world objects, enhancing the user's experience.
  • Industrial training: The technology can be applied in industrial training scenarios where virtual objects need to be accurately aligned with real-world objects for training purposes.
  • Medical applications: The method can be used in medical AR systems to overlay virtual images onto real-world objects, aiding in surgical procedures or medical training.

Problems solved by this technology:

  • Calibration and registration: The method solves the problem of accurately aligning virtual objects with real-world objects in video see-through AR systems, improving the overall AR experience.
  • Position tracking: By obtaining position data for each camera, the method ensures accurate tracking of the calibration object and virtual objects in the AR system.

Benefits of this technology:

  • Improved accuracy: The method allows for precise calibration and registration of virtual objects, resulting in a more realistic and immersive AR experience.
  • Efficient calibration process: By using stereo images and position data, the method simplifies the calibration process, reducing the time and effort required.
  • Flexibility: The ability to adjust virtual-camera parameters based on differences between virtual and real objects allows for fine-tuning and optimization of the AR system.


Original Abstract Submitted

In one embodiment, a method includes capturing, using a pair of cameras of a video see-through AR system, stereo images of a predetermined calibration object having a predetermined pose and obtaining, by a position sensor, position data for each of the pair of cameras at a time when the stereo images are captured. The method further includes generating a 3D reconstruction of the calibration object. The method further includes performing a registration process by generating, using parameters of each of a pair of stereo virtual cameras, stereo virtual views that include the predetermined calibration object and determining, for each of the stereo virtual views, one or more differences between the predetermined calibration object in the virtual images and a virtual rendering of the calibration object, and then using those differences to either adjust the virtual-camera parameters and repeat the registration process or to store the parameters for the system.