Apple Inc.
DECOMPOSITION OF MACHINE LEARNING OPERATIONS

Abstract:

The subject technology receives a representation of a neural network (NN) model to be executed on an electronic device, the representation of the NN model including nodes corresponding to intermediate layers of the NN model. The subject technology determines, for the respective operation corresponding to each node in each respective intermediate layer of the NN model, a respective set of operations that are mathematically equivalent to the respective operation such that an aggregation of outputs of the respective set of operations is equivalent to an output of the respective operation. The subject technology generates a graph based on each respective set of operations, wherein the graph includes a set of branches, each branch includes a plurality of operations. The subject technology determines a respective order for executing each branch of the graph.