Google LLC (20240428816). AUDIO-VISUAL HEARING AID

AUDIO-VISUAL HEARING AID

Organization Name

Google LLC

Inventor(s)

Anatoly Efros of Rishon LeTsiyon (IL)

Noam Etzion-rosenberg of Binyamina (IL)

Tal Remez of Ramat Gan (IL)

Oran Lang of Ramat Gan (IL)

Inbar Mosseri of Raanana (IL)

Israel Or Weinstein of Tel Aviv (IL)

Benjamin Schlesinger of Ramat Hasharon (IL)

Michael Rubinstein of Natick MA (US)

Ariel Ephrat of Efrat (IL)

Yukun Zhu of Shoreline WA (US)

Stella Laurenzo of Seattle WA (US)

Amit Pitaru of Brooklyn NY (US)

Yossi Matias of Tel Aviv (IL)

AUDIO-VISUAL HEARING AID

This abstract first appeared for US patent application 20240428816 titled 'AUDIO-VISUAL HEARING AID

Original Abstract Submitted

methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio-visual speech separation. a method includes: receiving, by a user device, a first indication of one or more first speakers visible in a current view recorded by a camera of the user device, in response, generating a respective isolated speech signal for each of the one or more first speakers that isolates speech of the first speaker in the current view and sending the isolated speech signals for each of the one or more first speakers to a listening device operatively coupled to the user device, receiving, by the user device, a second indication of one or more second speakers visible in the current view recorded by the camera of the user device, and in response generating and sending a respective isolated speech signal for each of the one or more second speakers to the listening device.