18470220. TIME-BOUND HYPERPARAMETER TUNING (Oracle International Corporation)
TIME-BOUND HYPERPARAMETER TUNING
Organization Name
Oracle International Corporation
Inventor(s)
Ankit Kumar Aggarwal of Mumbai IN
Hariharan Balasubramanian of Redmond WA US
TIME-BOUND HYPERPARAMETER TUNING
This abstract first appeared for US patent application 18470220 titled 'TIME-BOUND HYPERPARAMETER TUNING
Original Abstract Submitted
Techniques for time-bound hyperparameter tuning are disclosed. The techniques enable the determination of optimized hyperparameters for a machine learning (ML) model given a specified time bound using a three-stage approach. A series of trials are executed, during each of which the ML model is trained using a distinct set of hyperparameters. In the first stage, a small number of trials are executed to initialize the algorithm. In the second and third stages, a certain number of trials are executed in each stage. The number of trials to run in each stage are determined using one or more computer-implemented techniques. The computer-implemented techniques can also be used to narrow the hyperparameter search space and the feature space. Following the third stage, a set of optimized hyperparameters is adopted based a predefined optimization criterion like minimization of an error function.