Passthrough Pipeline

Organization Name

apple inc.

Inventor(s)

Christian I. Moore of Sunnyvale CA (US)

Moinul H. Khan of San Jose CA (US)

Seyedkoosha Mirhosseini of Santa Clara CA (US)

Simon Fortin-deschenes of Santa Clara CA (US)

Passthrough Pipeline

This abstract first appeared for US patent application 20240404185 titled 'Passthrough Pipeline

Original Abstract Submitted

in one implementation, a method of pipelined blending an image with virtual content is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. the method includes capturing, with the image sensor, a first portion of an image of a physical environment. the method includes warping the first portion of the image of the physical environment to generate a warped first portion. the method includes blending the warped first portion with a first portion of virtual content to generate a blended first portion. the method includes displaying, on the display, the blended first portion. the method includes capturing, with the image sensor, a second portion of the image of the physical environment. the method includes warping the second portion of the image of the physical environment to generate a warped second portion. the method includes blending the warped second portion with a second portion of the virtual content to generate a blended second portion. the method includes displaying, on the display, the blended second portion, wherein displaying the blended first portion is initiated before blending the warped second portion is completed.