Amazon.com, Inc.
Load balancer employing slow start, weighted round robin target selection

Abstract:

A system includes a load balancer and storage including a first data structure and a second data structure. Each of the data structures includes a plurality of different weight levels. At least one of the weight levels of the first data structure includes an identifier of a target. At least one of the weight levels of the second data structure includes a map that associates a target identifier with a final weight value. Responsive to receipt of a request and responsive to a target identifier included at a given weight level in the first data structure corresponding to a pointer, the load balancer selects the target identified in the first data structure at the given weight level. Responsive to no target identifiers included at the given weight level in the first data structure, the load balancer selects a target identified in the second data structure at the given weight level. The load balancer forwards the request to the selected target.