Microsoft Corporation
Texture Based Fusion For Images With Cameras Having Differing Modalities

Abstract:

Techniques for generating an enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. Saliencies of the two images are determined, where the saliencies reflect amounts of texture variation present in those images. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. A determination is made as to how much texture from the first and/or second images to use to generate an enhanced image. This determining process is based on the edge detection weights included within the alpha map. Based on the edge detection weights, textures are merged from the common pixels to generate the enhanced image.