SAP SE
DETECTION OF MACHINE LEARNING MODEL DEGRADATION

Abstract:

A method may include training, based on a first training dataset, a machine learning model. A degradation of the machine learning model may be detected based on one or more accuracy key performance indicators including a prediction power metric and a prediction confidence metric. The degradation of the machine learning model may also be detected based on a drift and skew in an input dataset and/or an output dataset of the machine learning model. Furthermore, the degradation of the machine learning model may be detected based on an explicit feedback and/or an implicit feedback on a performance of the machine learning model. In response to detecting the degradation of the machine learning model, the machine learning model may be retrained based on a second training dataset that includes at least one training sample not included in the first training dataset. Related systems and articles of manufacture are also provided.