International Business Machines Corporation
Method and system for data quality delta analysis on a dataset

Abstract:

The present disclosure relates to a method for data quality delta analysis on a dataset. The method provides a set of data quality rules for the dataset. At least one delta rule of a set of data quality rules is defined as relevant for delta analysis of at least part of the dataset, the delta rule being a delta analysis quality rule. Data changes on the dataset are tracked. In response to determining that a number of modified records of the at least part of the dataset is higher than a predefined insert modification threshold, a data quality score may be determined for said modified records using the delta rule.