Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems

Mikio Nakano, Kazunori Komatani, Hironori Takeuchi


Abstract
This paper addresses the issue of the significant labor required to test interview dialogue systems. While interview dialogue systems are expected to be useful in various scenarios, like other dialogue systems, testing them with human users requires significant effort and cost. Therefore, testing with user simulators can be beneficial. Since most conventional user simulators have been primarily designed for training task-oriented dialogue systems, little attention has been paid to the personas of the simulated users. During development, testing interview dialogue systems requires simulating a wide range of user behaviors, but manually creating a large number of personas is labor-intensive. We propose a method that automatically generates personas for user simulators using a large language model. Furthermore, by assigning personality traits related to communication styles when generating personas, we aim to increase the diversity of communication styles in the user simulator. Experimental results show that the proposed method enables the user simulator to generate utterances with greater variation.
Anthology ID:
2025.sigdial-1.54
Volume:
Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
August
Year:
2025
Address:
Avignon, France
Editors:
Frédéric Béchet, Fabrice Lefèvre, Nicholas Asher, Seokhwan Kim, Teva Merlin
Venue:
SIGDIAL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
678–696
Language:
URL:
https://aclanthology.org/2025.sigdial-1.54/
DOI:
Bibkey:
Cite (ACL):
Mikio Nakano, Kazunori Komatani, and Hironori Takeuchi. 2025. Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems. In Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 678–696, Avignon, France. Association for Computational Linguistics.
Cite (Informal):
Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems (Nakano et al., SIGDIAL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.sigdial-1.54.pdf