STORING AND OBTAINING ATTRIBUTE DATA OF ATTRIBUTES OF MACHINE LEARNING MODELS

Abstract: in some implementations, a controller may receive a request for an inference. the controller may determine, based on the received request for the inference, a first inference model of a plurality of inference models, to generate the inference. the controller may obtain, from a memory associated with an inference cache, first attribute data regarding first attributes of the first inference model. a location of the first attribute data, in the memory, may be determined using the inference cache. the attributes may include weights associated with the first inference model, biases associated with the first inference model, and a structure of the first inference model. the controller may utilize the first attribute data to generate the inference based on the request.

Inventor(s): Chris NORRIE, Igor ZIPER, Pitamber SHUKLA

CPC Classification: G06N5/04 (Inference or reasoning models)

Search for rejections for patent application number 20250165816