Amazon.com, Inc.
Managing timestamps in a sequential update stream recording changes to a database partition

Abstract:

Systems and methods for managing timestamps for a sequential update stream in a distributed system. A system includes a plurality of storage nodes of a data stream service of a provider network. Each storage node includes one or more processors and memory storing instructions executable by the one or more processors. The instructions cause the one or more processors to create a shard, at the storage node, for storing records of a sequential update stream recording changes to a database partition. The instructions also cause the one or more processors to assign a timestamp for the shard based on a local clock of the storage node. The instructions further cause the one or more processors to adjust the timestamp for the shard to a time later than a timestamp for a previous shard of the sequential update stream stored at a different storage node of the plurality of storage nodes.