International Business Machines Corporation
DIFFERENCE-GUIDED VIDEO ANALYSIS

Abstract:

A method can include obtaining, from a video having a first resolution, a set of frames having a second resolution. The first resolution can be higher than the second resolution. The set of frames can include a first frame and a second frame. The method can include generating a difference feature map. The method can include obtaining a third frame having the first resolution. The method can include detecting, based on the difference feature map, a first location of a first object in the third frame. The method can include cropping, from the third frame, a first cropped area. The first cropped area can be smaller than a third frame area. The method can include generating, based on a feature map and the difference feature map, a spatial attention layer. The method can include detecting, by the spatial attention layer, the first object in the first cropped area.