Alibaba Group Holding Limited
APPARATUS AND METHOD FOR NEURAL NETWORK PROCESSING

Abstract:

The present disclosure relates to neural network processing apparatus and method. An exemplary neural network processing apparatus includes: a memory for storing data; an operation unit to perform an operation on a first batch of tensors; a statistics determination unit communicatively coupled to the operation unit and configured to receive an output from the operation unit and determine statistics from the output; and a normalization unit communicatively coupled to the memory and the statistics determination unit and configured to receive a second batch of tensors from the memory and the statistics from the statistics determination unit and to normalize the second batch of tensors using the statistics.