Cisco technology, inc. (20250148222). EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
Organization Name
Inventor(s)
Jean- Philippe Vasseur of Combloux FR
Grégory Mermoud of Venthône CH
Pierre-André Savalle of Rueil-Malmaison FR
EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
This abstract first appeared for US patent application 20250148222 titled 'EVALUATION FRAMEWORK FOR LLM-BASED NETWORK TROUBLESHOOTING AND MONITORING AGENTS
Original Abstract Submitted
in one implementation, a device uses a large language model-based agent to perform a task in a network, to obtain a first result. the device executes code in the network to perform the task, to obtain a second result. the device makes a comparison between the first result and the second result. the device provides, based in part on the comparison, one or more performance metrics for the large language model-based agent for display.