Alibaba Group Holding Limited
METHODS AND SYSTEMS FOR PERFORMING INFERENCE WITH A NEURAL NETWORK

Abstract:

The present disclosure provides methods, systems, and non-transitory computer readable media for performing inference with a neural network. The systems include one or more processing units configured to instantiate a neural network comprising a bypass switch that is associated with at least two bypass networks, wherein each of the at least two bypass networks have at least one hidden layer, the bypass switch is configured to select a bypass network of the at least two bypass networks to activate, and any non-selected bypass network of the at least two bypass networks is not activated.