International Business Machines Corporation
CONTINUAL LEARNING USING CROSS CONNECTIONS

Abstract:

A method, a computer system, and a computer program product for using distinct paths with cross connections for distinct tasks to prevent catastrophic forgetting in class-incremental scenarios. Embodiments of the present invention may include receiving one or more tasks sequentially. Embodiments of the present invention may include applying one or more shareable blocks to the one or more tasks. Embodiments of the present invention may include learning one or more distinct paths for the one or more tasks. Embodiments of the present invention may include adding one or more cross connections between the one or more tasks. Embodiments of the present invention may include adding an aggregation block to collect one or more outputs from the distinct paths of each of the one or more tasks. Embodiments of the present invention may include providing a prediction.