Snap inc. (20250095282). GENERATING GROUND TRUTH DATASETS FOR VIRTUAL REALITY EXPERIENCES

From WikiPatents
Jump to navigation Jump to search

GENERATING GROUND TRUTH DATASETS FOR VIRTUAL REALITY EXPERIENCES

Organization Name

snap inc.

Inventor(s)

Kai Zhou of Wr Neudorf AT

Qi Qi of Los Angeles CA US

Jeroen Hol of Hengelo NL

GENERATING GROUND TRUTH DATASETS FOR VIRTUAL REALITY EXPERIENCES

This abstract first appeared for US patent application 20250095282 titled 'GENERATING GROUND TRUTH DATASETS FOR VIRTUAL REALITY EXPERIENCES

Original Abstract Submitted

systems and methods of generating ground truth datasets for producing virtual reality (vr) experiences, for testing simulated sensor configurations, and for training machine-learning algorithms. in one example, a recording device with one or more cameras and one or more inertial measurement units captures images and motion data along a real path through a physical environment. a slam application uses the captured data to calculate the trajectory of the recording device. a polynomial interpolation module uses chebyshev polynomials to generate a continuous time trajectory (ctt) function. the method includes identifying a virtual environment and assembling a simulated sensor configuration, such as a vr headset. using the ctt function, the method includes generating a ground truth output dataset that represents the simulated sensor configuration in motion along a virtual path through the virtual environment. the virtual path is closely correlated with the motion along the real path as captured by the recording device. accordingly, the output dataset produces a realistic and life-like vr experience. in addition, the methods described can be used to generate multiple output datasets, at various sample rates, which are useful for training the machine-learning algorithms which are part of many vr systems.