International Business Machines Corporation
DETERMINING SYSTEM PERFORMANCE WITHOUT GROUND TRUTH

Abstract:

Techniques for determining system performance without ground truth include receiving a trained model and one or more generator models, the trained model having been trained on training data. The trained model is used on testing data to produce labeled testing data, and the labeled testing data is used to train a proxy model. The one or more generator models are used to produce synthetic training data that is representative of the training data. The proxy model is used on the synthetic training data to produce predictions, and performance of the trained model is determined based on the predictions by the proxy model.