METHOD, DEVICE, AND COMPUTER PROGRAM PRODUCT FOR CACHING

Abstract: embodiments of the present disclosure relate to a method, a device, and a computer program product for caching. the method includes determining whether a length of a to-be-processed token sequence is greater than a cache length threshold associated with a key-value (kv) data cache. the method further includes determining, in response to the length of the to-be-processed token sequence being greater than the cache length threshold, target kv data based on a token sequence exceeding the cache length threshold in the to-be-processed token sequence. in addition, the method further includes determining a target token based on the to-be-processed token sequence, the kv data cache, and the target kv data.

Inventor(s): Qiang Chen, Pedro Fernandez Orellana

CPC Classification: G06F12/0886 (in hierarchically structured memory systems, e.g. virtual memory systems)

Search for rejections for patent application number 20250231883