Salesforce, inc. (20250088509). SYSTEM AND METHOD FOR GLOBAL RATE LIMITING
SYSTEM AND METHOD FOR GLOBAL RATE LIMITING
Organization Name
Inventor(s)
Ran Yao of San Francisco CA (US)
Xiaoyuan Zhou of Bellevue WA (US)
Alekhaya Kondapuram of San Francisco CA (US)
Tony Wong of San Francisco CA (US)
Pratima Nambiar of San Francisco CA (US)
Rama Chavali of San Francisco CA (US)
SYSTEM AND METHOD FOR GLOBAL RATE LIMITING
This abstract first appeared for US patent application 20250088509 titled 'SYSTEM AND METHOD FOR GLOBAL RATE LIMITING
Original Abstract Submitted
disclosed herein are system, method, and computer program product embodiments for implementing global rate limiting of an api cluster capable of dynamically implementing updates without a restart of any instantiation within the api cluster. a local service includes an envoy and a customer resource definition. when an update is received, the customer resource definition identifies changes to be made to a global rate limiting service and dynamically injects those changes into the global rate limiting service. the changes can be instance-specific, with multiple different versions stored for the various instantiations within the cluster. the envoy also extracts and converts header information from a received request into one or more descriptor keys. the global rate limiting service determine global rate limiting based on a set of rules applied to the descriptor keys.