08/12/2020

Do Word Embeddings Capture Spelling Variation?

Dong Nguyen, Jack Grieve

Keywords:

Abstract Paper Similar Papers

Abstract: Analyses of word embeddings have primarily focused on semantic and syntactic properties. However, word embeddings have the potential to encode other properties as well. In this paper, we propose a new perspective on the analysis of word embeddings by focusing on spelling variation. In social media, spelling variation is abundant and often socially meaningful. Here, we analyze word embeddings trained on Twitter and Reddit data. We present three analyses using pairs of word forms covering seven types of spelling variation in English. Taken together, our results show that word embeddings encode spelling variation patterns of various types to some extent, even embeddings trained using the skipgram model which does not take spelling into account. Our results also suggest a link between the intentionality of the variation and the distance of the non-conventional spellings to their conventional spellings.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6204-do-word-embeddings-capture-spelling-variationquestion
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 14:50 
 0
 0
 0
 0
 19:35 
 0
 0
 0
 0
 7:01 
 0
 0
 0
 0
 15:57 
 0
 0
 0
 0
 15:22 
 0
 0
 0
 0
 15:35 
 0
 0
 0
 0
 3:26 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 14:10 
 0
 0
 0
 0
 6:59 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 10:39 
 0
 0
 0
 0
 7:00 
 0
 0
 0
 0
 12:11 
 0
 0
 0
 0
 12:57 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 14:25 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 11:02 
 0
 0
 0
 0
 15:11 
 0
 0
 0
 0
 12:36 
 0
 0
 0
 0
 17:39 
 0
 0
 0
 0
 12:25 
 0
 0
 0
 0
 8:15 
 0
 0
 0
 0
 1:04 
 0
 0
 0
 0
 9:51 
 0
 0
 0
 0
 15:10 
 0
 0
 0
 0
 12:23 
 0
 0
 0
 0
 10:34 
 0
 0
 0
 0
 14:39 
 0
 0
 0
 0
 9:06 
 0
 0
 0
 0
 6:59 
 0
 0
 0
 0
 10:25 
 0
 0
 0
 0
 13:44 
 0
 0
 0
 0
 10:08 
 0
 0
 0
 0
 12:44 
 0
 0
 0
 0
 9:45 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 10:03