Royal Bank of Canada
SYSTEM AND METHOD FOR IMPROVING DEEP NEURAL NETWORK PERFORMANCE

Abstract:

An improved computer implemented method and corresponding systems and computer readable media for improving performance of a deep neural network are provided to mitigate effects related to catastrophic forgetting in neural network learning. In an embodiment, the method includes storing, in memory, logits of a set of samples from a previous set of tasks (D.sub.1); and maintaining classification information from the previous set of tasks by utilizing the logits for matching during training on a new set of tasks (D.sub.2).