Google llc (20250010482). Multimodal Object Identification

Multimodal Object Identification

Organization Name

google llc

Inventor(s)

Michael Joseph Quinlan of Sunnyvale CA US

Gabriel A. Cohen of Alameda CA US

Multimodal Object Identification

This abstract first appeared for US patent application 20250010482 titled 'Multimodal Object Identification

Original Abstract Submitted

methods, systems, and apparatus for receiving a command for controlling a robot, the command referencing an object, receiving sensor data for a portion of an environment of the robot, identifying, from the sensor data, a gesture of a human that indicates a spatial region located outside of the portion of the environment described by the sensor data, searching map data for the object, determining, based at least on searching the map data for the object referenced in the command, that the object referenced in the command is present in the spatial region, and in response to determining that the object referenced in the command is present in the spatial region, controlling the robot to perform an action with respect to the object referenced in the command.