US Patent Application 18218405. METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION simplified abstract
Contents
METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION
Organization Name
Inventor(s)
METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION - A simplified explanation of the abstract
- This abstract for appeared for US patent application number 18218405 Titled 'METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION'
Simplified Explanation
The abstract describes a system and method for knowledge distillation in machine learning models. It explains that the method involves training a condenser model to transfer knowledge between a teacher model and a student model. This trained condenser model can then be used to generate new student models more efficiently.
Original Abstract Submitted
The present techniques generally relate to a system and method for knowledge distillation between machine learning, ML, models. In particular, the present application relates to a computer-implemented method for training a condenser model to learn how to transfer knowledge between a teacher model and a student model, and using this trained condenser model to more quickly generate new student models.