International Business Machines Corporation
Reliable workflow system provenance tracking at runtime

Abstract:

A method, computer program product, and system for providing provenance tracking in a workflow system. The computer-implemented process provides for one or more processors to receive a workflow definition input. One or more processors perform workflow job commands, in response to receiving a workflow definition, and a workflow instance request. One or more processors access an input file associated with the workflow instance. One or more processors generate, at run-time, provenance metadata. One or more processors generate, at run-time, a global file identification (ID) associated with an output file. One or more processors link the global file ID and the provenance metadata to the output file of the workflow instance, and one or more processors store the output file, which includes the global file ID and the provenance metadata, both linked to the output file.