18743866. LLM FINE-TUNING FOR CODE GENERATION (Oracle International Corporation)
LLM FINE-TUNING FOR CODE GENERATION
Organization Name
Oracle International Corporation
Inventor(s)
Mengqing Guo of Issaquah WA US
Vinod Mamtani of Bellevue WA US
LLM FINE-TUNING FOR CODE GENERATION
This abstract first appeared for US patent application 18743866 titled 'LLM FINE-TUNING FOR CODE GENERATION
Original Abstract Submitted
Systems, methods, and other embodiments associated with automated fine-tuning of software code generation by large language models are described herein. In one embodiment, a method accesses a collection of software code samples that intermix sample code and human language description. The method generates prompts to an LLM to write code that performs as described by the human language description of the sample code. The method fine-tunes a large language model to generate software code based on a code generation loss function that evaluates code generated by the LLM in response to the prompts. The method generates an evaluation score for performance of the tuned large language model as a code generator based on code generation loss for second generated code. And, the method automatically signals that fine-tuning of the tuned large language is complete in response to the evaluation score satisfying a threshold.
(Ad) Transform your business with AI in minutes, not months
Trusted by 1,000+ companies worldwide
