US Patent Application 18218405. METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION simplified abstract
Jump to navigation
Jump to search
Contents
METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION
Organization Name
Inventor(s)
METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION - A simplified explanation of the abstract
- This abstract for appeared for US patent application number 18218405 Titled 'METHOD FOR KNOWLEDGE DISTILLATION AND MODEL GENERTATION'
Simplified Explanation
The abstract describes a system and method for knowledge distillation in machine learning models. It explains that the method involves training a condenser model to transfer knowledge between a teacher model and a student model. This trained condenser model can then be used to generate new student models more efficiently.
Original Abstract Submitted
The present techniques generally relate to a system and method for knowledge distillation between machine learning, ML, models. In particular, the present application relates to a computer-implemented method for training a condenser model to learn how to transfer knowledge between a teacher model and a student model, and using this trained condenser model to more quickly generate new student models.
