DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning

Praveen Venkateswaran, Evelyn Duesterwald, Vatche Isahagian


Abstract
Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and additional slot information to fine-tune and prompt large pre-trained language models and elicit slot values from the dialogue context. Significant manual effort and domain knowledge is required to design effective prompts, limiting the generalizability of these approaches to new domains and tasks. In this work, we propose DiSTRICT, a generalizable in-context tuning approach for DST that retrieves highly relevant training examples for a given dialogue to fine-tune the model without any hand-crafted templates. Experiments with the MultiWOZ benchmark datasets show that DiSTRICT outperforms existing approaches in various zero-shot and few-shot settings using a much smaller model, thereby providing an important advantage for real-world deployments that often have limited resource availability.
Anthology ID:
2023.emnlp-main.310
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5101–5112
Language:
URL:
https://aclanthology.org/2023.emnlp-main.310
DOI:
10.18653/v1/2023.emnlp-main.310
Bibkey:
Cite (ACL):
Praveen Venkateswaran, Evelyn Duesterwald, and Vatche Isahagian. 2023. DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 5101–5112, Singapore. Association for Computational Linguistics.
Cite (Informal):
DiSTRICT: Dialogue State Tracking with Retriever Driven In-Context Tuning (Venkateswaran et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.310.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.310.mp4