Intent Discovery with Frame-guided Semantic Regularization and Augmentation

Yajing Sun, Rui Zhang, Jingyuan Yang, Wei Peng


Abstract
Most existing intent discovery methods leverage representation learning and clustering to transfer the prior knowledge of known intents to unknown ones. The learned representations are limited to the syntactic forms of sentences, therefore, fall short of recognizing adequate variations under the same meaning of unknown intents. This paper proposes an approach utilizing frame knowledge as conceptual semantic guidance to bridge the gap between known intents representation learning and unknown intents clustering. Specifically, we employ semantic regularization to minimize the bidirectional KL divergence between model predictions for frame-based and sentence-based samples. Moreover, we construct a frame-guided data augmenter to capture intent-friendly semantic information and implement contrastive clustering learning for unsupervised sentence embedding. Extensive experiments on two benchmark datasets show that our method achieves substantial improvements in accuracy (5%+) compared to solid baselines.
Anthology ID:
2023.findings-acl.898
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14254–14261
Language:
URL:
https://aclanthology.org/2023.findings-acl.898
DOI:
10.18653/v1/2023.findings-acl.898
Bibkey:
Cite (ACL):
Yajing Sun, Rui Zhang, Jingyuan Yang, and Wei Peng. 2023. Intent Discovery with Frame-guided Semantic Regularization and Augmentation. In Findings of the Association for Computational Linguistics: ACL 2023, pages 14254–14261, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Intent Discovery with Frame-guided Semantic Regularization and Augmentation (Sun et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.898.pdf