Discovering New Intents with Deep Aligned Clustering

摘要

Discovering new intents is a crucial task in dialogue systems. Most existing methods are limited in transferring the prior knowledge from known intents to new intents. These methods also have difficulties in providing high-quality supervised signals to learn clustering-friendly features for grouping unlabeled intents. In this work, we propose an effective method (Deep Aligned Clustering) to discover new intents with the aid of limited known intent data. Firstly, we leverage a few labeled known intent samples as prior knowledge to pre-train the model. Then, we perform k-means to produce cluster assignments as pseudo-labels. Moreover, we propose an alignment strategy to tackle the label inconsistency problem during clustering assignments. Finally, we learn the intent representations under the supervision of the aligned pseudo-labels. With an unknown number of new intents, we predict the number of intent categories by eliminating lowconfidence intent-wise clusters. Extensive experiments on two benchmark datasets show that our method is more robust and achieves substantial improvements over the state-of-theart methods.

出版物
Proceedings of the AAAI Conference on Artificial Intelligence
张瀚镭
张瀚镭
博士研究生

我的研究方向为多模态对话意图发现。

徐华
徐华
长聘副教授, Expert Systems with Application 副主编,博士生导师
林廷恩
硕士

2017年进组,2020年获得硕士学位,清华大学计算机系优秀硕士毕业生。

相关