Wipro Limited
METHOD AND SYSTEM FOR OPTIMIZING MEMORY REQUIREMENT FOR TRAINING AN ARTIFICIAL NEURAL NETWORK MODEL

Abstract:

This disclosure relates to method and system for optimizing memory requirement for training an artificial neural network (ANN) model employed for natural language processing (NLP). In one embodiment, the method may include receiving a plurality of training parameters and a plurality of model parameters, selecting a set of model parameters from among the plurality of model parameters for training the ANN model based on a characteristic and an architecture of the ANN model, masking the set of model parameters in one or more layers of the ANN model based on a set of pre-defined rules to generate a set of masked model parameters, determining an amount of memory required for training the ANN model based on the set of masked model parameters, and providing the set of masked model parameters for training the ANN model when the amount of memory required is less than a determined threshold.