18627860. LLM FINE-TUNING FOR TEXT SUMMARIZATION (Oracle International Corporation)
LLM FINE-TUNING FOR TEXT SUMMARIZATION
Organization Name
Oracle International Corporation
Inventor(s)
Mengqing Guo of Issaquah WA US
Vinod Mamtani of Bellevue WA US
LLM FINE-TUNING FOR TEXT SUMMARIZATION
This abstract first appeared for US patent application 18627860 titled 'LLM FINE-TUNING FOR TEXT SUMMARIZATION
Original Abstract Submitted
Systems, methods, and other embodiments associated with automated fine-tuning of text summarization for large language models are described herein. In one embodiment, a method accesses a collection of text samples. The text samples include a body of text and an example summary. The method fine-tunes a large language model (LLM) based on a loss function that compares the example summary and a generated summary generated by the LLM. The example and generated summaries are compared at sentence, paragraph, and/or article levels. The method generates an evaluation score for performance of the tuned LLM as a text summarizer based on a further comparison of a reference summary and a summary generated by the tuned LLM. The method then automatically determines to deploy the tuned LLM to a text summarization task in response to the evaluation score satisfying a threshold.