Alibaba Group Holding Limited
SYSTEMS AND METHODS FOR PROVIDING VECTOR-WISE SPARSITY IN A NEURAL NETWORK

Abstract:

The present disclosure relates to systems and methods for providing vector-wise sparsity in neural networks. In some embodiments, an exemplary method for providing vector-wise sparsity in a neural network, comprises: dividing a matrix associated with the neural network into a plurality of vectors; selecting a first subset of non-zero elements from the plurality of vectors to form a pruned matrix; and outputting the pruned matrix for executing the neural network using the pruned matrix.