Groupon, Inc.
Automated adaptive data analysis using dynamic data quality assessment

Abstract:

Embodiments provide for automated dynamic data quality assessment. A data quality job including a new data sample is received. If the new data sample is determined to be added to a reservoir of data samples, a quality verification request is sent to an oracle. A new data sample quality estimate is received from the oracle. The new data sample and estimate can be added to the reservoir. A judgment associated with a new data sample is received from a predictive model. Whether to send a new data sample quality verification request to an oracle is determined. If a new data sample quality estimate is received from the oracle, whether to add the new data sample and the judgment to the reservoir is determined.