Apple Inc.
Data augmentation for local feature detector and descriptor learning using appearance transform

Abstract:

Providing localization data includes obtaining a first image of a scene associated with a first condition, determining one or more target conditions, and applying an appearance transfer network to the first image to obtain one or more synthesized images comprising the scene, wherein the scene is associated with the one or more target conditions in the synthesized image. A first patch is selected from the first image, wherein the first patch comprises a keypoint, and an image location is determined for the first patch. Then one or more additional patches can be obtained using the synthesized images and the image location. A descriptor network may be trained to provide localization data based on the first patch and the one or more additional patches.