Snap Inc. (20250061658). HAND-RELATED DATA ANNOTATIONS WITH AN AUGMENTED REALITY DEVICE
HAND-RELATED DATA ANNOTATIONS WITH AN AUGMENTED REALITY DEVICE
Organization Name
Inventor(s)
Laura Rosalia Luidolt of Vienna (AT)
Kai Zhou of Wiener Neudorf (AT)
Adrian Schoisengeier of Vienna (AT)
HAND-RELATED DATA ANNOTATIONS WITH AN AUGMENTED REALITY DEVICE
This abstract first appeared for US patent application 20250061658 titled 'HAND-RELATED DATA ANNOTATIONS WITH AN AUGMENTED REALITY DEVICE
Original Abstract Submitted
an augmented reality (ar) device generates hand annotations for an image depicting a user's hand. the device includes a display, a processor, and a memory storing instructions for performing operations. the device performs a calibration operation to generate a 3-d model of the user's hand based on measurements. the calibration operation prompts the user to mimic the hand gesture presented by the animated virtual representation of a hand to obtain optimal images of the hand for hand pose estimation. a 3-d virtual representation of a hand in a hand pose corresponding with a hand gesture is generated based on the 3-d model. the device presents the 3-d virtual representation of the hand in ar via the display. during presentation, the device detects an input and captures an image of the user's hand positioned to correspond with the 3-d virtual representation. the captured image is stored with corresponding hand annotations based on the 3-d model.