02/02/2021

Knowledge-Guided Object Discovery with Acquired Deep Impressions

Jinyang Yuan, Bin Li, Xiangyang Xue

Keywords:

Abstract Paper Similar Papers

Abstract: We present a framework called Acquired Deep Impressions (ADI) which continuously learns knowledge of objects as ``impressions'' for compositional scene understanding. In this framework, the model first acquires knowledge from scene images containing a single object in a supervised manner, and then continues to learn from novel multi-object scene images which may contain objects that have not been seen before without any further supervision, under the guidance of the learned knowledge as humans do. By memorizing impressions of objects into parameters of neural networks and applying the generative replay strategy, the learned knowledge can be reused to generate images with pseudo-annotations and in turn assist the learning of novel scenes. The proposed ADI framework focuses on the acquisition and utilization of knowledge, and is complementary to existing deep generative models proposed for compositional scene representation. We adapt a base model to make it fall within the ADI framework and conduct experiments on two types of datasets. Empirical results suggest that the proposed framework is able to effectively utilize the acquired impressions and improve the scene decomposition performance.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948558
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 1
 5:13 
 0
 0
 0
 0
 6:12 
 0
 0
 0
 0
 15:13 
 0
 1
 1
 1
 3:24 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:06 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 10:59 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 9:50 
 0
 0
 0
 0
 14:02 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 7:13 
 0
 0
 0
 0
 5:46 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 12:31 
 0
 0
 0
 0
 18:49 
 0
 0
 0
 0
 4:30 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 3:25 
 0
 0
 0
 0
 7:41 
 0
 0
 0
 0
 2:47 
 0
 0
 0
 0
 2:46 
 0
 0
 0
 0
 10:58 
 0
 0
 0
 0
 9:38 
 0
 0
 0
 0
 14:06 
 0
 0
 0
 0
 4:24 
 0
 0
 0
 0
 4:11 
 0
 0
 0
 0
 14:23 
 0
 0
 0
 0
 5:59 
 0
 0
 0
 0
 15:09 
 0
 0
 0
 0
 14:05 
 0
 0
 0
 0
 13:22 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 3:19