18388003. EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS (Cisco Technology, Inc.)
EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
Organization Name
Inventor(s)
Jean- Philippe Vasseur of Combloux FR
Grégory Mermoud of Venthône CH
Pierre-André Savalle of Rueil-Malmaison FR
EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
This abstract first appeared for US patent application 18388003 titled 'EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
Original Abstract Submitted
In one implementation, a device uses a large language model-based agent to perform a task in a network, to obtain a first result. The device executes code in the network to perform the task, to obtain a second result. The device makes a comparison between the first result and the second result. The device provides, based in part on the comparison, one or more performance metrics for the large language model-based agent for display.