Amazon technologies, inc. (20250104693). NATURAL LANGUAGE GENERATION
NATURAL LANGUAGE GENERATION
Organization Name
Inventor(s)
Constantinos Papayiannis of Berlin DE
Roberto Barra Chicote of Cambridge GB
James Garnet Droppo of Carnation WA US
NATURAL LANGUAGE GENERATION
This abstract first appeared for US patent application 20250104693 titled 'NATURAL LANGUAGE GENERATION
Original Abstract Submitted
techniques for using a language model (e.g., a large language model (llm)) to generate a natural language response to a user input and prosody information (e.g., voice characteristics associated with a synthetic voice to output the natural language response to the user) are described. the prosody information may correspond to a natural language (e.g., text or tokenized) description, a spectrogram, and/or a latent representation of the voice characteristic(s) associated with the natural language response. in some embodiments, the natural language response and the prosody information may be generated by different portions of layers of the language model. in such embodiments, the output of the layer(s) of the language model configured to generate the natural language response may be provided to the layer(s) of the language model configured to generate the prosody information and the output may be used to generate the prosody information, and vice versa.