MACHINE-LEARNING BASED GESTURE RECOGNITION USING MULTIPLE SENSORS: abstract simplified (18202857)

• This abstract for appeared for patent application number 18202857 Titled 'MACHINE-LEARNING BASED GESTURE RECOGNITION USING MULTIPLE SENSORS'

Simplified Explanation

This abstract describes a device that uses machine learning to recognize gestures. The device has two sensors that provide different types of sensor output. The device's processor uses this sensor output as input to a machine learning model that has been trained to predict gestures. Based on the output from the machine learning model, the processor determines the predicted gesture and performs a predetermined action on the device in response.

Original Abstract Submitted

A device implementing a system for machine-learning based gesture recognition includes at least one processor configured to, receive, from a first sensor of the device, first sensor output of a first type, and receive, from a second sensor of the device, second sensor output of a second type that differs from the first type. The at least one processor is further configured to provide the first sensor output and the second sensor output as inputs to a machine learning model, the machine learning model having been trained to output a predicted gesture based on sensor output of the first type and sensor output of the second type. The at least one processor is further configured to determine the predicted gesture based on an output from the machine learning model, and to perform, in response to determining the predicted gesture, a predetermined action on the device.