DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation

Ziyi Zhu, Olivier Tieleman, Caitlin A. Stamatis, Luka Smyth, Thomas D. Hull, Daniel Reid Cahn, Jinghong Chen, Matteo Malgaroli


Abstract
Realistic user simulation is crucial for training and evaluating multi-turn dialogue systems, yet creating simulators that accurately replicate human behavior remains a significant challenge. An effective simulator must expose the failure modes of the systems under evaluation. This work introduces Direct Iterative Adversarial Learning (DIAL), an adversarial framework that iteratively enhances user simulator realism through a competitive dynamic between a generator (user simulator) and a discriminator. When applied to mental health support, a domain characterized by diverse failure types and a critical dependence on realistic user behavior for failure detection, DIAL restores lexical diversity diminished by supervised fine-tuning and drastically reduces discriminator accuracy. The resulting simulator exhibits a strong correlation between simulated and real failure occurrence rates while maintaining low distributional divergence of failure modes. These findings indicate that DIAL is a promising method for developing realistic user simulators in multi-turn dialogue, facilitating reliable and cost-effective system evaluation prior to deployment.
Anthology ID:
2026.findings-emnlp.46
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
925–942
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.46/
DOI:
Bibkey:
Cite (ACL):
Ziyi Zhu, Olivier Tieleman, Caitlin A. Stamatis, Luka Smyth, Thomas D. Hull, Daniel Reid Cahn, Jinghong Chen, and Matteo Malgaroli. 2026. DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 925–942, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DIAL: Direct Iterative Adversarial Learning for Realistic Multi-Turn Dialogue Simulation (Zhu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.46.pdf