OLISIA: a Cascade System for Spoken Dialogue State Tracking

Léo Jacqmin, Lucas Druart, Yannick Estève, Benoît Favre, Lina M Rojas, Valentin Vielzeuf


Abstract
Though Dialogue State Tracking (DST) is a core component of spoken dialogue systems, recent work on this task mostly deals with chat corpora, disregarding the discrepancies between spoken and written language. In this paper, we propose OLISIA, a cascade system which integrates an Automatic Speech Recognition (ASR) model and a DST model. We introduce several adaptations in the ASR and DST modules to improve integration and robustness to spoken conversations. With these adaptations, our system ranked first in DSTC11 Track 3, a benchmark to evaluate spoken DST. We conduct an in-depth analysis of the results and find that normalizing the ASR outputs and adapting the DST inputs through data augmentation, along with increasing the pre-trained models size all play an important role in reducing the performance discrepancy between written and spoken conversations.
Anthology ID:
2023.dstc-1.12
Volume:
Proceedings of The Eleventh Dialog System Technology Challenge
Month:
September
Year:
2023
Address:
Prague, Czech Republic
Editors:
Yun-Nung Chen, Paul Crook, Michel Galley, Sarik Ghazarian, Chulaka Gunasekara, Raghav Gupta, Behnam Hedayatnia, Satwik Kottur, Seungwhan Moon, Chen Zhang
Venues:
DSTC | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
95–104
Language:
URL:
https://aclanthology.org/2023.dstc-1.12
DOI:
Bibkey:
Cite (ACL):
Léo Jacqmin, Lucas Druart, Yannick Estève, Benoît Favre, Lina M Rojas, and Valentin Vielzeuf. 2023. OLISIA: a Cascade System for Spoken Dialogue State Tracking. In Proceedings of The Eleventh Dialog System Technology Challenge, pages 95–104, Prague, Czech Republic. Association for Computational Linguistics.
Cite (Informal):
OLISIA: a Cascade System for Spoken Dialogue State Tracking (Jacqmin et al., DSTC-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.dstc-1.12.pdf