Meta platforms technologies, llc (20250123679). SYSTEMS AND METHODS FOR OBJECT TRACKING USING FUSED DATA
SYSTEMS AND METHODS FOR OBJECT TRACKING USING FUSED DATA
Organization Name
meta platforms technologies, llc
Inventor(s)
Chengyuan Yan of San Bruno CA US
Christian Forster of Zofingen CH
SYSTEMS AND METHODS FOR OBJECT TRACKING USING FUSED DATA
This abstract first appeared for US patent application 20250123679 titled 'SYSTEMS AND METHODS FOR OBJECT TRACKING USING FUSED DATA
Original Abstract Submitted
in one embodiment, a method includes capturing, using one or more cameras implemented in a wearable device worn by a user, a first image depicting at least a part of a hand of the user holding a controller in an environment, identifying one or more features from the first image to estimate a pose of the hand of the user, estimating a first pose of the controller based on the pose of the hand of the user and an estimated grip that defines a relative pose between the hand of the user and the controller, receiving imu data of the controller, and estimating a second pose of the controller by updating the first pose of the controller using the imu data of the controller. the method utilizes multiple data sources to track the controller under various conditions of the environment to provide an accurate controller tracking consistently.