18887751. LARGE LANGUAGE MODEL OUTPUT ENTAILMENT (Google LLC)
LARGE LANGUAGE MODEL OUTPUT ENTAILMENT
Organization Name
Inventor(s)
Kelvin Gu of Mountain View CA US
Zhuyun Dai of Mountain View CA US
Panupong Pasupat of Mountain View CA US
Chen Elkind of Mountain View CA US
Hagai Taitelbaum of Mountain View CA US
Mukund Sundararajan of Mountain View CA US
Vered Cohen of Mountain View CA US
Itay Karo of Mountain View CA US
Norbert Kalb of Mountain View CA US
LARGE LANGUAGE MODEL OUTPUT ENTAILMENT
This abstract first appeared for US patent application 18887751 titled 'LARGE LANGUAGE MODEL OUTPUT ENTAILMENT
Original Abstract Submitted
Implementations are described herein for identifying potentially false information in generative model output by performing entailment evaluation of generative model output. In various implementations, data indicative of a query may be processed to generate generative model output. Textual fragments may be extracted from the generative model output, and a subset of the textual fragments may be classified as being suitable for textual entailment analysis. Textual entailment analysis may be performed on each textual fragment of the subset, including formulating a search query based on the textual fragment, retrieving document(s) responsive to the search query, and processing the textual fragment and the document(s) using entailment machine learning model(s) to generate prediction(s) of whether the at least one document corroborates or contradicts the textual fragment. When natural language (NL) responsive to the query is rendered at a client device, annotation(s) may be rendered to express the prediction(s).
- Google LLC
- Kelvin Gu of Mountain View CA US
- Zhuyun Dai of Mountain View CA US
- Panupong Pasupat of Mountain View CA US
- Chen Elkind of Mountain View CA US
- Eran Ofek of Rehovot CH
- Hagai Taitelbaum of Mountain View CA US
- Mukund Sundararajan of Mountain View CA US
- Vered Cohen of Mountain View CA US
- Itay Karo of Mountain View CA US
- Norbert Kalb of Mountain View CA US
- Yossi Matias of Tel Aviv IL
- Tej Toor of Brooklyn NY US
- Teghan Tracy of Boulder CO US
- G06F16/332
- G06F16/33
- G06F16/35
- CPC G06F16/3329
(Ad) Transform your business with AI in minutes, not months
Trusted by 1,000+ companies worldwide