02/02/2021

Continual General Chunking Problem and SyncMap

Danilo Vasconcellos Vargas, Toshitake Asabuki

Keywords:

Abstract Paper Similar Papers

Abstract: Humans possess an inherent ability to chunk sequences into their constituent parts. In fact, this ability is thought to bootstrap language skills and learning of image patterns which might be a key to a more animal-like type of intelligence. Here, we propose a continual generalization of the chunking problem (an unsupervised problem), encompassing fixed and probabilistic chunks, discovery of temporal and causal structures and their continual variations. Additionally, we propose an algorithm called SyncMap that can learn and adapt to changes in the problem by creating a dynamic map which preserves the correlation between variables. Results of SyncMap suggest that the proposed algorithm learn near optimal solutions, despite the presence of many types of structures and their continual variation. When compared to Word2vec, PARSER and MRIL, SyncMap surpasses or ties with the best algorithm on 66% of the scenarios while being the second best in the remaining 34%. SyncMap's model-free simple dynamics and the absence of loss functions reveal that, perhaps surprisingly, much can be done with self-organization alone.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38949058
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 10:04 
 0
 0
 0
 0
 13:34 
 0
 0
 0
 0
 9:02 
 0
 0
 0
 0
 4:43 
 0
 0
 0
 0
 3:31 
 0
 0
 0
 0
 12:12 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 2:58 
 0
 0
 0
 0
 14:22 
 0
 0
 0
 0
 4:44 
 0
 0
 0
 0
 10:12 
 0
 0
 0
 0
 14:54 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 5:22 
 0
 0
 0
 0
 11:03 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 9:09 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 1
 5:00 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 4:39 
 0
 0
 0
 0
 14:59 
 1
 0
 0
 0
 6:21 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 8:42 
 0
 0
 0
 0
 11:57