Visa Inc.
Metadata-driven distributed dynamic reader and writer

Abstract:

A method for receiving text files, each having data defined in various format types. The text files are received without a reference to a schema defining the text files. A description file for each of the text files describing one of the format types is received and the description file includes a separate file from a corresponding text file. Before processing the text file and absent receiving the schema, the method identifies a data structure of the description file, the data structure comprising one or more parameters and definitions of the various format types. Each of the text files is processed and during processing of each of the text files, dynamically generating, at run-time, one or more reader engines to read the data in the text files and dynamically extracting, at run-time, data based on the identified data structure. The method generates an output file with the extracted data.