Dynamic Prompting: Large Language Models for Task Oriented Dialog

Jan Nehring, Akhil Juneja, Adnan Ahmad, Roland Roller, Dietrich Klakow


Abstract
Large Language Models show impressive results in many different applications, most notably in the context of question-answering and open dialog situations. However, it is still an open question how to use those models for task-oriented dialogs such as booking or customer information systems, and such. In this work, we propose Dynamic Prompting, an architecture for task-oriented dialog, integrating the benefits of Large Language Models and showcasing the approach on the MultiWOZ 2.2 dataset. Our architecture leads to a high task success rate, provides sensible and specific answers, and is resistant to hallucinations. Further, we show that Dynamic Prompting is able to answer questions that were not anticipated by the dialog systems designer and that it can correct several types of errors and other characteristics of the system.
Anthology ID:
2024.clicit-1.72
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
644–653
Language:
URL:
https://aclanthology.org/2024.clicit-1.72/
DOI:
Bibkey:
Cite (ACL):
Jan Nehring, Akhil Juneja, Adnan Ahmad, Roland Roller, and Dietrich Klakow. 2024. Dynamic Prompting: Large Language Models for Task Oriented Dialog. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 644–653, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
Dynamic Prompting: Large Language Models for Task Oriented Dialog (Nehring et al., CLiC-it 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.clicit-1.72.pdf