Amazon.com, Inc.
Record-by-record live migration using a lock store

Abstract:

Methods, systems, and computer-readable media for record-by-record live migration using a lock store are disclosed. Migration of a data set comprises acquiring a migration lock from a lock store for an individual record being migrated. An instance of the record is then stored in the destination, and the record is deleted from the source. Subsequently, the migration lock is deleted from the lock store or otherwise released. During the migration, a rate at which insert requests are directed to the destination is dialed up. During the process of updating an insert treatment configuration across a distributed set of migration router instances, an insert lock is acquired from the lock store for each record being inserted. Also metadata is stored indicating a determined location for the record being inserted. Any subsequent requests to insert a record with a same key are inserted at the indicated determined location.