International Business Machines Corporation
DETECTION FOR AI-BASED RECOMMENDATION

Abstract:

In an approach, a processor loads a set of scoring batches, each scoring batch containing multiple scoring payload records, the scoring payload records storing input data provided to an AI-based recommendation system. A processor derives quality indicators for each scoring batch from the scoring payload records. A processor aggregates the quality indicators to obtain an aggregated quality indicator, wherein the aggregated quality indicator specifies an estimated quality of recommendations by the AI-based recommendation system for each respective scoring batch. A processor adds the aggregated quality indicator to a set. A processor calculates a key performance indicator for each scoring batch. A processor adds the key performance indicator to a set. A processor determines that a degree of correlation between the set of aggregated quality indicators and the set of key performance indicators is within a predefined range. A processor generates a notification that the AI-based recommendation system has been ignored.