Novel Feature Discovery for Task-Oriented Dialog Systems

Vinh Thinh Ho, Mohamed Soliman, Abdalghani Abujabal


Abstract
A novel feature represents a cluster of semantically equivalent novel user requests e.g., requests to play a song on a service or read user’s messages. Detecting and supporting novel features is crucial towards wider adoption of dialog systems by end users. Intuitively, features are represented by a combination of intents, slot types and/or their values. For example, while playing a song is a feature represented by a single intent (PlayMusic) only, playing a song on a service is another feature represented by the combination of PlayMusic intent and ServiceName slot type. Prior work on novelty detection limits the scope of features to those represented by novel single intents, leading to (1) giant clusters spanning several user-perceived fine-grained features belonging to the same intent, (2) incoherent interpretation of clusters from users’ perspective (no direct connection to some user-perceived feature), and (3) missing those features spanning several intents. In this work, we introduce feature discovery as opposed to single intent discovery, which aims at discovering novel features spanning a combination of intents and slots, and present a technique for discovering novel features from user utterances. Experiments on two datasets demonstrate the effectiveness of our approach and consistently show its ability to detect novel features.
Anthology ID:
2023.findings-eacl.59
Volume:
Findings of the Association for Computational Linguistics: EACL 2023
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
782–792
Language:
URL:
https://aclanthology.org/2023.findings-eacl.59
DOI:
10.18653/v1/2023.findings-eacl.59
Bibkey:
Cite (ACL):
Vinh Thinh Ho, Mohamed Soliman, and Abdalghani Abujabal. 2023. Novel Feature Discovery for Task-Oriented Dialog Systems. In Findings of the Association for Computational Linguistics: EACL 2023, pages 782–792, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Novel Feature Discovery for Task-Oriented Dialog Systems (Ho et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-eacl.59.pdf
Video:
 https://aclanthology.org/2023.findings-eacl.59.mp4