Alibaba Group Holding Limited
DATA REUSE AND EFFICIENT PROCESSING SCHEME IN EXECUTING CONVOLUTIONAL NEURAL NETWORK

Abstract:

The present disclosure relates to a device for executing a convolutional neural network operation. The device comprises a first memory, a processing array comprising a plurality of processing strings, and a controller. The controller can be configured to fetch one or more batches of data into the first memory, regroup the one or more batches of data into multiple work items, wherein a first work item partially overlaps one or more work items among the multiple work items, and broadcast the multiple work items to the processing array, wherein the first work item is transferred to two or more processing strings of the processing array.