Amazon.com, Inc.
Dynamic transfer learning for neural network modeling

Abstract:

The present disclosure is directed to optimizing transfer learning for neural networks by creating a dynamic transfer network configuration through gated architecture. In some embodiments, transfer learning implements multiple parameter sharing schemes across a source task and a target task. The gating architecture can learn the optimal parameter sharing schemes as the neural network is trained. In some embodiments, the system can be used in named entity recognition applications where the training data is limited.