ASYNCHRONOUS STATISTIC-BASED RATE LIMITING IN DISTRIBUTED SYSTEM

Abstract: in an example embodiment, rate limiting is performed at the instance level (i.e., locally), but utilizing throughput statistics of other instances. these statistics may be measured locally by each instance and then transmitted to a central store, where they are aggregated. each instance is then able to asynchronously request the aggregated statistics from the central store and use this information to manage the parameters of its own local rate limiter.

Inventor(s): Yoav Srebrnik, Brandon Farrell, Davin Bogan

CPC Classification: G06F9/485 (Program initiating; Program switching, e.g. by interrupt)

Search for rejections for patent application number 20250217183