Improving Long Distance Slot Carryover in Spoken Dialogue Systems

Tongfei Chen, Chetan Naik, Hua He, Pushpendre Rastogi, Lambert Mathias


Abstract
Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is relevant to the current turn. Previous work on the slot carryover task used models that made independent decisions for each slot. A close analysis of the results show that this approach results in poor performance over longer context dialogues. In this paper, we propose to jointly model the slots. We propose two neural network architectures, one based on pointer networks that incorporate slot ordering information, and the other based on transformer networks that uses self attention mechanism to model the slot interdependencies. Our experiments on an internal dialogue benchmark dataset and on the public DSTC2 dataset demonstrate that our proposed models are able to resolve longer distance slot references and are able to achieve competitive performance.
Anthology ID:
W19-4111
Volume:
Proceedings of the First Workshop on NLP for Conversational AI
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Yun-Nung Chen, Tania Bedrax-Weiss, Dilek Hakkani-Tur, Anuj Kumar, Mike Lewis, Thang-Minh Luong, Pei-Hao Su, Tsung-Hsien Wen
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
96–105
Language:
URL:
https://aclanthology.org/W19-4111
DOI:
10.18653/v1/W19-4111
Bibkey:
Cite (ACL):
Tongfei Chen, Chetan Naik, Hua He, Pushpendre Rastogi, and Lambert Mathias. 2019. Improving Long Distance Slot Carryover in Spoken Dialogue Systems. In Proceedings of the First Workshop on NLP for Conversational AI, pages 96–105, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Improving Long Distance Slot Carryover in Spoken Dialogue Systems (Chen et al., ACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-4111.pdf