18820989. SYSTEM AND METHOD FOR EVALUATING THE PERFORMANCE AND USAGE OF A QUESTION ANSWERING COGNITIVE COMPUTING TOOL (State Farm Mutual Automobile Insurance Company)
Contents
SYSTEM AND METHOD FOR EVALUATING THE PERFORMANCE AND USAGE OF A QUESTION ANSWERING COGNITIVE COMPUTING TOOL
Organization Name
State Farm Mutual Automobile Insurance Company
Inventor(s)
Sunitha Garapati of Normal IL (US)
Adam Hellman of Bloomington IL (US)
Darcy Bogle of Bloomington IL (US)
Oscar Rebollo Martinez of Bloomington IL (US)
Shawn Perrone of Bloomington IL (US)
Matt Floyd of Johns Creek GA (US)
SYSTEM AND METHOD FOR EVALUATING THE PERFORMANCE AND USAGE OF A QUESTION ANSWERING COGNITIVE COMPUTING TOOL
This abstract first appeared for US patent application 18820989 titled 'SYSTEM AND METHOD FOR EVALUATING THE PERFORMANCE AND USAGE OF A QUESTION ANSWERING COGNITIVE COMPUTING TOOL
Original Abstract Submitted
A system and method for evaluating the performance and usage of a cognitive computing tool which answers questions from users. A log file for these interactions includes the questions, the answers and a confidence rating assigned by the tool to each answer. Questions and answers are analyzed to determine validity, accuracy, and categories by subject matter experts or text analytics tools, and the results are added to the log file. Comments and sentiments from users may be analyzed and added to the log file. Additional data about the users, such as identities, demographics, and locations, may be added. Data from the log file may be presented in a dashboard display as metrics, such as trends and comparisons, describing the usage and performance of the cognitive computing tool. Answers may be displayed as they were presented to the users. Selectable filters may be provided to control the data displayed.
