18492163. MODEL EMERGENT CAPABILITY ANALYSIS (International Business Machines Corporation)
MODEL EMERGENT CAPABILITY ANALYSIS
Organization Name
International Business Machines Corporation
Inventor(s)
Michael Gringo Angelo Reglos Bayona of Dublin IE
MODEL EMERGENT CAPABILITY ANALYSIS
This abstract first appeared for US patent application 18492163 titled 'MODEL EMERGENT CAPABILITY ANALYSIS
Original Abstract Submitted
An embodiment trains, using a database of tasks, a classifier model to classify an input task into a task category. An embodiment generates a plurality of prompts. An embodiment applies a first prompt in the plurality of prompts to a trained model, the trained model producing a first model output in response to the first prompt. An embodiment classifies, using the trained classifier model, the first model output into a first task category. An embodiment determines that the first task category is an undesired task category. An embodiment adjusts, responsive to determining the first task category is the undesired task category, the trained model, the adjusting altering a capability of the trained model to perform a task in the first task category.