20240085993.BODY POSE ESTIMATION USING SELF-TRACKED CONTROLLERS simplified abstract (meta platforms technologies, llc)

From WikiPatents
Jump to navigation Jump to search

BODY POSE ESTIMATION USING SELF-TRACKED CONTROLLERS

Organization Name

meta platforms technologies, llc

Inventor(s)

Andrew Garrod Bosworth of San Mateo CA (US)

BODY POSE ESTIMATION USING SELF-TRACKED CONTROLLERS - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240085993 titled 'BODY POSE ESTIMATION USING SELF-TRACKED CONTROLLERS

Simplified Explanation

The patent application describes a computing system that can determine the pose of a device held by or attached to a user's hand, as well as the pose of a headset worn by the user. The system can also determine the positions of keypoints on the user's body based on images captured by cameras on the device and headset, as well as the poses of the device and headset. Using this information, the system can determine the overall body pose of the user.

  • The computing system determines the pose of a device and a headset based on sensor data captured by each respective device.
  • The system calculates the positions of keypoints on the user's body using images from cameras on the device and headset, as well as the poses of each device.
  • By combining this data, the system can determine the overall body pose of the user.

Potential Applications

This technology could be used in:

  • Virtual reality and augmented reality systems for more accurate tracking of user movements.
  • Fitness and sports training applications for analyzing and improving body posture and movements.

Problems Solved

This technology solves the problem of accurately tracking and analyzing body poses and movements in real-time, which is crucial for various applications such as virtual reality, fitness, and sports training.

Benefits

  • Improved user experience in virtual reality and augmented reality applications.
  • Enhanced feedback and analysis for fitness and sports training.
  • More accurate and detailed tracking of body movements.

Potential Commercial Applications

  • Virtual reality gaming systems.
  • Fitness and sports training software and devices.

Possible Prior Art

One possible prior art could be motion capture technology used in the entertainment industry for creating realistic animations in movies and video games.

Unanswered Questions

How does the system handle occlusions or obstructions in the camera views that may affect the accuracy of body pose determination?

The patent application does not provide details on how the system deals with occlusions or obstructions in the camera views that could impact the accuracy of body pose determination.

What kind of sensors are used in the device and headset to capture the necessary data for determining poses and keypoints on the user's body?

The patent application does not specify the types of sensors used in the device and headset to capture the data needed for pose determination and keypoint calculation.


Original Abstract Submitted

in one embodiment, a computing system may determine a pose of a device held by or attached to a hand of a user based on sensor data captured by the device. the system may determine a pose of a headset worn by the user based on sensor data captured by the headset. the system may determine positions of a first set of keypoints associated with a first portion of a body of the user based on (1) one or more first images captured by one or more cameras of the device, (2) the pose of the device, (3) one or more second images captured by one or more cameras of the headset and (4) the pose of the headset. the system may determine a body pose of the user based at least on the positions of the first set of keypoints.