Deepmind technologies limited (20250111284). CONFIDENCE CALIBRATION FOR MACHINE LEARNING MODELS
CONFIDENCE CALIBRATION FOR MACHINE LEARNING MODELS
Organization Name
Inventor(s)
Urvashi Khandelwal of Los Altos CA US
Kelvin Gu of Redwood City CA US
CONFIDENCE CALIBRATION FOR MACHINE LEARNING MODELS
This abstract first appeared for US patent application 20250111284 titled 'CONFIDENCE CALIBRATION FOR MACHINE LEARNING MODELS
Original Abstract Submitted
methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for confidence calibration of machine learning models. in one aspect, a method comprises receiving a plurality of query inputs to a target machine learning model that is configured to assign initial confidence scores to model outputs generated by the target machine learning model, processing the query inputs using a calibration model to generate precision data for the target machine learning model that specifies a precision curve mapping confidence thresholds to precisions, receiving a new input for the target machine learning model, processing the new input using the target machine learning model to generate a predicted model output for the new input and to assign an initial confidence score to the predicted model output, and generating a final output for the new input using the initial confidence score and the precision data for the target machine learning model.
