Amazon.com, Inc.
Archiver for data stream service

Abstract:

Data is obtained from a data stream managed by a data stream service prior to expiration of a data retention time. The data is archived to a data store distinct from the data stream service (e.g., in a full or compacted mode). Access to the archived data is provided via a proxy that intercepts requests directed to the streaming service. For example, the proxy or a redirect utility for the proxy may intercept a query, and for data specified in the query that is past the retention expiration time, the data is retrieved from the data store. For data specified in the query that has not yet expired, the data is retrieved from the data stream service. In either case, the system responds to the query with the retrieved data according to the access interface of the data stream service (e.g., injecting the retrieved data into a data stream).