SMARTS: A Small-to-large Model Coordinated Retrieval and Response Framework for Task-Oriented Dialogue

Jiale Chen, Xuelian Dong, Shengcheng Ye, Wenxiu Xie, Kun Zeng, Tianyong Hao


Abstract
Task-Oriented Dialogue (TOD) systems are commonly used to assist users in achieving specific goals through human-computer interactions. Existing methods typically employ a single model during response generation to simultaneously learn response style and perform fine-grained knowledge retrieval. However, these task-coupling methods often result in suboptimal responses generation and the inclusion of irrelevant knowledge in responses, making the optimization of TOD systems more difficult. To address this challenge, we propose a novel small-to-large model collaboration framework for task-oriented dialogue, named SMARTS. This framework utilizes a small language model to generate style-only responses (without knowledge), while a large language model retrieves top-1 relevant knowledge from the knowledge base independently. The style-only responses are finally filled with top-1 relevant knowledge and form the completed responses to users. Finally, a re-thinker is designed to check the language fluency and knowledge accuracy of responses. Experiments on two public datasets demonstrate that SMARTS outperforms existing methods by an average of 5.79% in Entity F1.
Anthology ID:
2026.findings-aacl.133
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2603–2612
Language:
URL:
https://aclanthology.org/2026.findings-aacl.133/
DOI:
Bibkey:
Cite (ACL):
Jiale Chen, Xuelian Dong, Shengcheng Ye, Wenxiu Xie, Kun Zeng, and Tianyong Hao. 2026. SMARTS: A Small-to-large Model Coordinated Retrieval and Response Framework for Task-Oriented Dialogue. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 2603–2612, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
SMARTS: A Small-to-large Model Coordinated Retrieval and Response Framework for Task-Oriented Dialogue (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.133.pdf