International Business Machines Corporation
Convolutional neural network with sparse and complementary kernels

Abstract:

Technologies for providing convolutional neural networks are described. An analysis component determines an initial convolutional layer in a network architecture of a convolutional neural network and one or more subsequent convolutional layers in the network architecture. A replacement component replaces original convolutional kernels in the initial convolutional layer with initial sparse convolutional kernels, and replaces subsequent convolutional kernels in one or more subsequent convolutional layers with complementary sparse convolutional kernels. The complementary sparse kernels have a complementary pattern with respect to sparse kernels of a previous convolutional layer. Analyzing the network architecture and a trained model of a convolutional neural network can determine the original convolutional kernels and replace those kernels with sparse kernels based on similarity and/or weight in an initial layer, with sparse complementary kernels used in subsequent layers.