02/02/2021

Using Hindsight to Anchor Past Knowledge in Continual Learning

Arslan Chaudhry, Albert Gordo, Puneet Dokania, Philip Torr, David Lopez-Paz

Keywords:

Abstract Paper Similar Papers

Abstract: In continual learning, the learner faces a stream of data whose distribution changes over time. Modern neural networks are known to suffer under this setting, as they quickly forget previously acquired knowledge. To address such catastrophic forgetting, many continual learning methods implement different types of experience replay, re-learning on past data stored in a small buffer known as episodic memory. In this work, we complement experience replay with a new objective that we call ``anchoring'', where the learner uses bilevel optimization to update its knowledge on the current task, while keeping intact the predictions on some anchor points of past tasks. These anchor points are learned using gradient-based optimization to maximize forgetting, which is approximated by fine-tuning the currently trained model on the episodic memory of past tasks. Experiments on several supervised learning benchmarks for continual learning demonstrate that our approach improves the standard experience replay in terms of both accuracy and forgetting metrics and for various sizes of episodic memory.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38949167
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 10:05 
 0
 0
 0
 0
 13:57 
 0
 0
 0
 0
 14:36 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 3:26 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 8:32 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 4:36 
 0
 0
 0
 0
 17:12 
 0
 0
 0
 0
 7:35 
 0
 0
 0
 0
 13:51 
 0
 0
 0
 0
 16:29 
 0
 0
 0
 0
 5:08 
 0
 0
 0
 0
 3:23 
 1
 1
 1
 1
 5:20 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 15:05 
 0
 0
 0
 0
 8:27 
 1
 0
 1
 0
 5:08 
 0
 0
 0
 0
 2:30 
 0
 0
 0
 0
 7:00 
 0
 0
 0
 0
 12:27 
 0
 0
 0
 0
 4:46 
 0
 0
 0
 0
 12:03 
 1
 1
 0
 0
 15:22 
 0
 0
 0
 0
 2:46 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 3:59 
 0
 0
 0
 0
 15:07 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 10:21 
 0
 0
 0
 0
 5:36 
 0
 0
 0
 0
 13:37 
 0
 0
 0
 0
 3:22