An Adaptive Prompt Generation Framework for Task-oriented Dialogue System

Jun Gao, Liuyu Xiang, Huijia Wu, Han Zhao, Yiqi Tong, Zhaofeng He


Abstract
The de facto way of utilizing black-box large language models (LLMs) to perform various downstream tasks is prompting. However, obtaining suitable prompts for specific tasks is still a challenging problem. While existing LLM-based methods demonstrate promising performance in task-oriented dialogue (TOD) task, they often require manual adjustment in prompt selection, or focus solely on dialogue understanding or generation. To address these issues, we propose an adaptive prompt generation framework to fully unleash the potential of LLMs for the comprehensive TOD system. Firstly, we design a trainable slot generator (TSG) that can generate domain and slot information in the belief state, which serves as prior knowledge for subsequent prompt generation. Next, we propose an adaptive prompt generator (APG) that utilizes the prior knowledge to generate prompts for the LLM, deriving the belief state and system response of the dialogue for evaluation. Finally, we evaluate our framework on the MultiWOZ 2.0 dataset. Extensive experiments demonstrate that our method outperforms existing methods. Our code and data will be released.
Anthology ID:
2023.findings-emnlp.76
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1078–1089
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.76
DOI:
10.18653/v1/2023.findings-emnlp.76
Bibkey:
Cite (ACL):
Jun Gao, Liuyu Xiang, Huijia Wu, Han Zhao, Yiqi Tong, and Zhaofeng He. 2023. An Adaptive Prompt Generation Framework for Task-oriented Dialogue System. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 1078–1089, Singapore. Association for Computational Linguistics.
Cite (Informal):
An Adaptive Prompt Generation Framework for Task-oriented Dialogue System (Gao et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.76.pdf