Microsoft Corporation
DETERMINING SCHEDULES FOR PROCESSING NEURAL NETWORKS ON HARDWARE

Abstract:

Embodiments of the present disclosure include systems and methods for determining schedules for processing neural networks on hardware. A set of instructions for processing data through a neural network is received. Based on a hardware definition specifying the set of hardware units and functions that each hardware unit in the set of the hardware unit is configured to perform, a schedule of a set of operations to be performed by a subset of the set of hardware units to implement the set of instructions are determined. The schedule of the set of operations are distributed to the subset of the set of hardware units.