Alibaba Group Holding Limited
PROCESSING UNIT, PROCESSOR CORE, NEURAL NETWORK TRAINING MACHINE, AND METHOD

Abstract:

Embodiments of the present disclosure provide a processing unit, a processor core, a neural network training machine and a method for processing. The method can include: acquiring a compressed weight signal; and decompressing the compressed weight signal into a weight signal and a trimming signal, wherein the weight signal comprises a weight of each neural network node, the trimming signal indicates whether the weight of each neural network node is used in a weight gradient computation, the trimming signal is used for controlling an access to an operand memory storing operands used in the weight computation of one or more neural network nodes corresponding to the operand memory, and the trimming signal is further used for controlling a computing unit to perform weight gradient computation using the weight signal and the operands for the one or more neural network nodes.