Amazon.com, Inc.
Resource management techniques for dialog-driven applications

Abstract:

A resource of a dialog-driven management service is allocated for a first set of requests based on determining that a population of capacity indicators in a throttling data structure exceeds a threshold. One or more capacity indicator deduction iterations associated with the resource are conducted during a time interval for which the resource remains allocated for the first set of requests. In a given iteration, a number of capacity indicators is deducted from the throttling data structure based on a resource throttling setting. A second set of requests is rejected based on the population of the throttling data structure.