Apple Inc. (20250111589). ENVIRONMENT-MODELING BASED CAMERA ADAPTATION FOR PASSTHROUGH EXTENDED REALITY SYSTEMS
ENVIRONMENT-MODELING BASED CAMERA ADAPTATION FOR PASSTHROUGH EXTENDED REALITY SYSTEMS
Organization Name
Inventor(s)
Simon Fortin-deschenes of Santa Clara CA US
Luke A Pillans of San Diego CA US
Anselm Grundhoefer of Campbell CA US
Christian I Moore of Sunnyvale CA US
Seyedkoosha Mirhosseini of Santa Clara CA US
ENVIRONMENT-MODELING BASED CAMERA ADAPTATION FOR PASSTHROUGH EXTENDED REALITY SYSTEMS
This abstract first appeared for US patent application 20250111589 titled 'ENVIRONMENT-MODELING BASED CAMERA ADAPTATION FOR PASSTHROUGH EXTENDED REALITY SYSTEMS
Original Abstract Submitted
various implementations provide passthrough video based on adjusting camera parameters based on environment modeling. an environment characteristic may be determined based on modeling the physical environment based on sensor data captured via one or more sensors. for example, this may involve determining environment light source optical characteristics, environment surfaces optical characteristics, a 3d mapping of the environment, user behavior, a prediction of optical characteristics of light coming in the camera, and the like. the method may involve, based on the environment characteristic, determining a camera parameter for an image captured via the image sensor. for example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. the method may determine the camera parameter based on user information, e.g., user preferences, user activity, etc. the method may involve providing passthrough video of the physical environment based on the determined camera parameter.
