Amazon.com, Inc.
System for reducing computations performed for iterative requests
Last updated:
Abstract:
To reduce the computational resources used to generate a response, certain inputs from a first request and corresponding outputs are stored in a data structure that is returned to a client device concurrent with a response. When a subsequent request is received, if an input of the subsequent request matches an input stored in the data structure, the output that corresponds to that input is used in a response rather that recomputing the output. For inputs that do not match an input in the data structure, an output is computed and included in a response. The data structure is then returned to the client device concurrent with the subsequent response. Outputs in the data structure may be periodically validated, or may be associated with an expiration time, to ensure that the data structure includes current and valid data.
Utility
30 Sep 2019
23 Nov 2021