InterviewArena: Estimating Uninformative Participants through Interactive Dialogue under Incomplete Information

Raika Koki, Karina Karasawa, Ryoki Kanayama, Yuki Suzumura, Haruto Fujita, Ryoma Obara, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, Shogo Matsuno


Abstract
We introduce InterviewArena, an interview-style multi-agent framework for evaluating large language models (LLMs) under incomplete information. By treating missing information as a single factor, we disentangle missing-information identification from dialogue-based reasoning. Experimental results show that while LLMs can capture relative differences between participants, predicting specific missing information remains unstable, highlighting the need to evaluate these capabilities separately.
Anthology ID:
2026.lmplayschool-1.5
Volume:
The Proceedings of Improving Language Models through Learning from Dialogue Game Interaction
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Alessandro Suglia, Mario Giulianelli, David Schlangen, Raffaella Bernardi, Raquel Fernández, Sherzod Hakimov, Sabrina McCallum, Davide Mazzaccara, Dieu-Thu Le, Oliver Lemon, Alexander Koller
Venues:
LM Playschool | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
49–56
Language:
URL:
https://aclanthology.org/2026.lmplayschool-1.5/
DOI:
Bibkey:
Cite (ACL):
Raika Koki, Karina Karasawa, Ryoki Kanayama, Yuki Suzumura, Haruto Fujita, Ryoma Obara, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, and Shogo Matsuno. 2026. InterviewArena: Estimating Uninformative Participants through Interactive Dialogue under Incomplete Information. In The Proceedings of Improving Language Models through Learning from Dialogue Game Interaction, pages 49–56, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
InterviewArena: Estimating Uninformative Participants through Interactive Dialogue under Incomplete Information (Koki et al., LM Playschool 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.lmplayschool-1.5.pdf