SAP SE
Scalable data extractor

Abstract:

Methods, systems, and computer-readable storage media for determining, by an extraction worker of a data extraction system, a number of pages based on data that is to be extracted from the source system, for each page, by a respective extraction worker: querying the source system, and storing a query result in a respective page file within a staging data file system of the data extraction system, for each extraction worker that queries the source system, verifying a status of the extraction worker after expiration of a predetermined delay time based on a timestamp of the page that the extraction worker is handling, and determining that a page status for each page is completed, and in response, posting an extraction completed message to inform the consuming system that the data has been extracted from the source system.