18454045. Augmenting Retrieval Systems With User-Provided Phonetic Signals (GOOGLE LLC)
Contents
Augmenting Retrieval Systems With User-Provided Phonetic Signals
Organization Name
Inventor(s)
Vikram Aggarwal of Palo Alto CA (US)
Ambarish Jash of San Francisco CA (US)
Sukhdeep Singh Sodhi of Sunnyvale CA (US)
Augmenting Retrieval Systems With User-Provided Phonetic Signals
This abstract first appeared for US patent application 18454045 titled 'Augmenting Retrieval Systems With User-Provided Phonetic Signals
Original Abstract Submitted
A method includes obtaining, from a user device associated with a user, an audio signature, the audio signature extracted from audio data corresponding to a query spoken by the user. The method also includes processing, using a neural network, the audio signature to identify document tokens that match the audio signature within a shared embedding space, the neural network trained to jointly embed audio signatures and document tokens in the shared embedding space. The method also includes retrieving, using the document tokens and the shared embedding space, a set of search results for the query, and providing, for output from the user device, one or more search results from the set of search results to the user.
