08/12/2020

Less is Better: A cognitively inspired unsupervised model for language segmentation

Jinbiao Yang, Stefan L. Frank, Antal van den Bosch

Keywords:

Abstract Paper Similar Papers

Abstract: Language users process utterances by segmenting them into many cognitive units, which vary in their sizes and linguistic levels. Although we can do such unitization/segmentation easily, its cognitive mechanism is still not clear. This paper proposes an unsupervised model, Less-is-Better (LiB), to simulate the human cognitive process with respect to language unitization/segmentation. LiB follows the principle of least effort and aims to build a lexicon which minimizes the number of unit tokens (alleviating the effort of analysis) and number of unit types (alleviating the effort of storage) at the same time on any given corpus. LiB’s workflow is inspired by empirical cognitive phenomena. The design makes the mechanism of LiB cognitively plausible and the computational requirement light-weight. The lexicon generated by LiB performs the best among different types of lexicons (e.g. ground-truth words) both from an information-theoretical view and a cognitive view, which suggests that the LiB lexicon may be a plausible proxy of the mental lexicon.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6475-less-is-better-a-cognitively-inspired-unsupervised-model-for-language-segmentation
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING Workshops 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 8:39 
 0
 0
 0
 0
 11:54 
 0
 0
 0
 0
 11:12 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 19:17 
 0
 0
 0
 0
 14:31 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 8:45 
 0
 0
 0
 0
 13:01 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 12:06 
 0
 0
 0
 0
 11:28 
 0
 0
 0
 0
 9:09 
 0
 0
 0
 0
 10:34 
 0
 0
 0
 0
 12:23 
 1
 0
 0
 0
 3:29 
 0
 0
 0
 0
 18:02 
 0
 0
 0
 0
 18:55 
 0
 0
 0
 0
 19:38 
 0
 0
 0
 0
 9:16 
 0
 0
 0
 0
 9:45 
 0
 0
 0
 0
 44:12 
 0
 0
 0
 0
 7:04 
 0
 0
 0
 0
 6:53 
 0
 0
 0
 0
 11:34 
 0
 0
 0
 0
 11:44 
 0
 0
 0
 0
 20:03 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 12:00 
 0
 0
 0
 0
 7:55 
 0
 0
 1
 1
 4:58 
 0
 0
 0
 0
 6:09 
 0
 0
 0
 0
 16:00 
 0
 0
 0
 0
 5:59