Mobile Robot with Audio Perception System

Abstract: a mobile robot includes a microphone array with a set of microphones. the microphone array is at least partially disposed on the mobile robot. the mobile robot receives audio signals from the microphone array. audio feature data of acoustic activity is extracted from the audio signals. direction of arrival (doa) data of the acoustic activity is generated based on the audio signals. a machine learning model is configured to generate audio event data using the audio feature data. the audio event data identifies at least one sound source of the audio feature data. a knowledge graph is queried using the audio event data to obtain entity data. the entity data has a predetermined relation with the audio event data. semantic audio scene data is generated using the audio event data, the doa data, and the entity data. the mobile robot performs an action based on the semantic audio scene data.

Inventor(s): Pongtep Angkititrakul, Jonathan Francis, Luca Bondi, Samarjit Das

CPC Classification: G05D1/243 (SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES)

Search for rejections for patent application number 20250189970