SAP SE
Using transformations to verify computer vision quality

Abstract:

Techniques for using image dataset transformations to verify the quality of a computer vision system are disclosed. In some example embodiments, a computer-implemented method comprises: accessing a database to obtain a reference image; generating a plurality of new images based on the reference image using a plurality of transformations, each one of the plurality of transformations being configured to change a corresponding visual property of the reference image; feeding the plurality of new images into an image classifier to generate a corresponding classification result for each one of the plurality of new images; determining that the image classifier does not satisfy one or more accuracy criteria based on the generated classification results for the plurality of new images; and based on the determining that the image classifier does not satisfy the one or more accuracy criteria, selectively performing a function.