20250190763. Automated System F (BANK OF AMERICA)
Automated System for Detecting Likelihood of Falsified Outputs from Large Language Models (LLM)
Abstract: a computing platform may generate, using a test case generation model, a plurality of large language model (llm) test cases. the computing platform may input, into an llm, the plurality of llm test cases, which may produce a plurality of unverified llm test results. the computing platform may input, into a validation model, the plurality of llm test cases, which may produce a plurality of validated llm test results. the computing platform may compare, using a falsified output evaluation model, the plurality of unverified llm test results with the corresponding plurality of validated llm test results, which may produce an llm compliance score for the llm. the computing platform may compare the llm compliance score to a compliance threshold. based on identifying that the llm compliance score meets or exceeds the compliance threshold, the computing platform may automatically deploy the llm for use in an enterprise environment.
Inventor(s): Anthony Banuelos, Stephanie Pirman, Marvin Osorio
CPC Classification: G06N3/0455 (Auto-encoder networks; Encoder-decoder networks)
Search for rejections for patent application number 20250190763