SAP SE
Self-paced adversarial training for multimodal and 3D model few-shot learning

Abstract:

A method for generating synthetic data is provided. The method includes retrieving, from a database, a set of authentic base class images. The method further includes generating a three dimensional mesh of a base class. The method further includes retrieving, from the database, a set of textual descriptions. The method further includes retrieving a set of authentic novel class images. The method further includes generating, at a first neural network, a set of synthetic novel class images, the generating based on at least the three dimensional mesh, the set of textual descriptions, and/or the set of authentic novel class images. The method further includes training, based on at least the set of synthetic novel class images, a second neural network, the second neural network ranking the set of synthetic novel class images and outputting a set of highest ranked synthetic images from the set of synthetic novel class images.