ADOBE INC. (20250124235). USING GENERATIVE ARTIFICIAL INTELLIGENCE TO EVALUATE FINE-TUNED LANGUAGE MODELS
USING GENERATIVE ARTIFICIAL INTELLIGENCE TO EVALUATE FINE-TUNED LANGUAGE MODELS
Organization Name
Inventor(s)
Victor Soares Bursztyn of Mountain View CA US
Vaishnavi Muppala of San Jose CA US
Uttaran Bhattacharya of Sunnyvale CA US
Saayan Mitra of San Jose CA US
Kenneth George Russell of Mountain View CA US
Alexandru Ionut Hodorogea of San Francisco CA US
USING GENERATIVE ARTIFICIAL INTELLIGENCE TO EVALUATE FINE-TUNED LANGUAGE MODELS
This abstract first appeared for US patent application 20250124235 titled 'USING GENERATIVE ARTIFICIAL INTELLIGENCE TO EVALUATE FINE-TUNED LANGUAGE MODELS
Original Abstract Submitted
methods and systems are provided for using generative artificial intelligence to evaluate fine-tuned language models. in embodiments described herein, natural language text snippets are generated via a generative language model based on corresponding data. a language model is fine-tuned into a fine-tuned language model via a language model fine-tuning component using the natural language text snippets and the corresponding data as training data. independent natural language text snippets are generated via the generative language model based on the corresponding data. each independent natural language text snippet is different than each corresponding natural language text snippet. an evaluation metric of the fine-tuned language model is generated via an evaluation component based on the independent natural language text snippets and the corresponding data.
- ADOBE INC.
- Victor Soares Bursztyn of Mountain View CA US
- Xiang Chen of Palo Alto CA US
- Vaishnavi Muppala of San Jose CA US
- Uttaran Bhattacharya of Sunnyvale CA US
- Tong Yu of Fremont CA US
- Saayan Mitra of San Jose CA US
- Ryan Rossi of San Jose CA US
- Manas Garg of Fremont CA US
- Kenneth George Russell of Mountain View CA US
- Eunyee Koh of Sunnyvale CA US
- Alexandru Ionut Hodorogea of San Francisco CA US
- G06F40/40
- G06F40/279
- CPC G06F40/40