STORAGE SYSTEMS FOR LARGE LANGUAGE MODEL FINE-TUNING

Abstract: data is received from an application, and it is determined whether the received data is to be used for fine-tuning a large language model (llm). the received data is stored in a primary storage or in a secondary storage based at least in part on whether the received data is to be used for fine-tuning the llm. the secondary storage is configured to store data that is less frequently accessed than data stored in the primary storage. in response to determining that the received data is to be used for fine-tuning the llm, the received data is stored in the secondary storage. in one aspect, a query for information is received that is associated with particular data stored in the secondary storage and the query is input into the llm to provide the information without accessing the particular data stored.

Inventor(s): Ariel Navon, Alexander Bazarsky, Eran Sharon

CPC Classification: G06N3/0455 (Auto-encoder networks; Encoder-decoder networks)

Search for rejections for patent application number 20250165750