18888047. HYPERPARAMETER OPTIMIZATION WITH OPERATIONAL CONSTRAINTS (Amazon Technologies, Inc.)

HYPERPARAMETER OPTIMIZATION WITH OPERATIONAL CONSTRAINTS

Organization Name

Amazon Technologies, Inc.

Inventor(s)

Giovanni Zappella of Berlin (DE)

Valerio Perrone of Berlin (DE)

Iaroslav Shcherbatyi of Berlin (DE)

Rodolphe Jenatton of Berlin (DE)

Cedric Philippe Archambeau of Berlin (DE)

Matthias Seeger of Berlin (DE)

HYPERPARAMETER OPTIMIZATION WITH OPERATIONAL CONSTRAINTS

This abstract first appeared for US patent application 18888047 titled 'HYPERPARAMETER OPTIMIZATION WITH OPERATIONAL CONSTRAINTS

Original Abstract Submitted

Hyperparameters for tuning a machine learning system may be optimized using Bayesian optimization with constraints. The hyperparameter optimization may be performed for a received training set and received constraints. Respective probabilistic models for the machine learning system and constraint functions may be initialized, then hyperparameter optimization may include iteratively identifying respective values for hyperparameters using analysis of the respective models performed using an acquisition function implementing entropy search on the respective models, training the machine learning system using the identified values to determine measures of accuracy and constraint metrics, and updating the respective models using the determined measures.