02/02/2021

Discovering New Intents with Deep Aligned Clustering

Hanlei Zhang, Hua Xu, Ting-En Lin, Rui Lyu

Keywords:

Abstract Paper Similar Papers

Abstract: Discovering new intents is a crucial task in dialogue systems. Most existing methods are limited in transferring the prior knowledge from known intents to new intents. These methods also have difficulties in providing high-quality supervised signals to learn clustering-friendly features for grouping unlabeled intents. In this work, we propose an effective method (Deep Aligned Clustering) to discover new intents with the aid of limited known intent data. Firstly, we leverage a few labeled known intent samples as prior knowledge to pre-train the model. Then, we perform k-means to produce cluster assignments as pseudo-labels. Moreover, we propose an alignment strategy to tackle the label inconsistency problem during clustering assignments. Finally, we learn the intent representations under the supervision of the aligned pseudo-labels. With an unknown number of new intents, we predict the number of intent categories by eliminating low-confidence intent-wise clusters. Extensive experiments on two benchmark datasets show that our method is more robust and achieves substantial improvements over the state-of-the-art methods.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948740
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 18:50 
 0
 0
 0
 0
 15:09 
 0
 0
 0
 0
 8:33 
 0
 0
 0
 0
 3:10 
 0
 0
 0
 0
 10:26 
 0
 0
 0
 0
 5:12 
 0
 0
 0
 0
 15:06 
 0
 0
 0
 0
 10:27 
 0
 0
 0
 0
 19:44 
 0
 0
 0
 0
 14:43 
 0
 0
 0
 0
 15:12 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 10:03 
 0
 0
 0
 0
 3:02 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 12:02 
 0
 0
 0
 0
 14:26 
 0
 0
 0
 0
 10:02 
 0
 0
 0
 0
 18:11 
 0
 0
 0
 0
 16:14 
 0
 0
 0
 0
 14:07 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 11:34 
 0
 0
 0
 0
 17:25 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 2:56 
 0
 0
 0
 0
 15:49 
 0
 0
 0
 0
 11:50 
 0
 0
 0
 0
 14:05 
 0
 0
 0
 0
 10:12 
 0
 0
 0
 0
 13:29 
 0
 0
 0
 1
 16:40 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 12:04 
 0
 0
 0
 0
 5:12 
 0
 0
 0
 0
 7:06 
 0
 0
 0
 0
 14:37 
 0
 0
 0
 0
 13:53