Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions

James D. Finch, Yasasvi Josyula, Jinho D. Choi


Abstract
In task-oriented dialogue (TOD) systems, Slot Schema Induction (SSI) is essential for automatically identifying key information slots from dialogue data without manual intervention. This paper presents a novel state-of-the-art (SotA) approach that formulates SSI as a text generation task, where a language model incrementally constructs and refines a slot schema over a stream of dialogue data. To develop this approach, we present a fully automatic LLM-based TOD simulation method that creates data with high-quality state labels for novel task domains. Furthermore, we identify issues in SSI evaluation due to data leakage and poor metric alignment with human judgment. We resolve these by creating new evaluation data using our simulation method with human guidance and correction, as well as designing improved evaluation metrics. These contributions establish a foundation for future SSI research and advance the SotA in dialogue understanding and system development.
Anthology ID:
2026.tacl-1.5
Volume:
Transactions of the Association for Computational Linguistics, Volume 14
Month:
Year:
2026
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
81–99
Language:
URL:
https://aclanthology.org/2026.tacl-1.5/
DOI:
10.1162/tacl.a.66
Bibkey:
Cite (ACL):
James D. Finch, Yasasvi Josyula, and Jinho D. Choi. 2026. Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions. Transactions of the Association for Computational Linguistics, 14:81–99.
Cite (Informal):
Generative Induction of Dialogue Task Schemas with Streaming Refinement and Simulated Interactions (Finch et al., TACL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.tacl-1.5.pdf