Alibaba Group Holding Limited
System, method, and apparatus for synchronization among heterogeneous data sources

Abstract:

A method for synchronizing data among heterogeneous data sources is disclosed. The method may comprise obtaining a synchronization task and a corresponding operation classification, determining one or more Reader plugins and Writer plugins based on the corresponding operation classification, segmenting the synchronization task based on the one or more Reader plugins and Writer plugins to generate a Task queue, and using a corresponding number of the Reader plugins and the Writer plugins based on the Task queue to implement the synchronization task. The one or more Reader plugins may be configured to read data from a source and to send to the one or more Writer plugins, and the one or more Writer plugins may be configured to write the data to a destination.