RoleArena: Autonomous Plot Progression for Long-Horizon Multi-Agent Role-Playing

Qi Zhao, Jian Li, Yizhang Jin, Dongqi Liu, Hang Ding, Qi Song, Xiang-Yang Li


Abstract
Improving the plot progression ability of role-playing language agents (RPLAs) plays a critical role in enhancing user experience and dialogue immersion. However, research on plot progression in role-playing language agents is still limited. Existing datasets often contain too few dialogue turns and lack large-scale sentences with clear deterministic plot turns, which restricts further model development and evaluation. To bridge this gap, we propose RoleArena, an innovative multi-agent role-playing environment. By introducing a critic agent and combining discrete plot lines with environment-agent-based dynamic judgments, the system generates long multi-turn dialogues with key markers for plot progression. Based on RoleArena, we construct the PlotStream dataset, which contains 39.3k characters and 170k dialogues, with annotations for key plot progression sentences. In addition, based on PlotStream, we further develop PlotRole-7B and PlotRole-72B, RPLAs built upon the Qwen2.5 model and specialized in plot progression capabilities. Extensive experiments show that RoleArena and PlotRole improve dialogue generation with plot progression and strengthen the ability of plot progression.
Anthology ID:
2026.findings-emnlp.1160
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24553–24576
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1160/
DOI:
Bibkey:
Cite (ACL):
Qi Zhao, Jian Li, Yizhang Jin, Dongqi Liu, Hang Ding, Qi Song, and Xiang-Yang Li. 2026. RoleArena: Autonomous Plot Progression for Long-Horizon Multi-Agent Role-Playing. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 24553–24576, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
RoleArena: Autonomous Plot Progression for Long-Horizon Multi-Agent Role-Playing (Zhao et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1160.pdf