Task Proficiency-Aware Dialogue Analysis in a Real-Time Cooking Game Environment

Kaito Nakae, Michimasa Inaba


Abstract
Real-time collaborative dialogue tasks require dynamic, instantaneous decision-making and seamless coordination between participants, yet most existing studies on cooperative dialogues primarily focus on turn-based textual environments. This study addresses the critical gap in understanding human-human interaction patterns within dynamic, real-time collaborative scenarios. In this paper, we present a novel dataset collected from a real-time collaborative cooking game environment inspired by the popular game “Overcooked.” Our dataset comprises detailed annotations of participants’ task proficiency levels, game scores, game action logs, and transcribed voice dialogues annotated with dialogue act tags. Participants exhibited a broad range of gaming experience, from highly proficient players to those with minimal exposure to gaming controls. Through comprehensive analysis, we explore how individual differences in task proficiency influence dialogue patterns and collaborative outcomes. Our findings reveal key dialogue acts and adaptive communication strategies crucial for successful real-time collaboration. Furthermore, this study provides valuable insights into designing adaptive dialogue systems capable of dynamically adjusting interaction strategies based on user proficiency, paving the way for more effective human-AI collaborative systems. The dataset introduced in this study is publicly available at: https://github.com/UEC-InabaLab/OverCookedChat.
Anthology ID:
2025.sigdial-1.57
Volume:
Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
August
Year:
2025
Address:
Avignon, France
Editors:
Frédéric Béchet, Fabrice Lefèvre, Nicholas Asher, Seokhwan Kim, Teva Merlin
Venue:
SIGDIAL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
764–779
Language:
URL:
https://aclanthology.org/2025.sigdial-1.57/
DOI:
Bibkey:
Cite (ACL):
Kaito Nakae and Michimasa Inaba. 2025. Task Proficiency-Aware Dialogue Analysis in a Real-Time Cooking Game Environment. In Proceedings of the 26th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 764–779, Avignon, France. Association for Computational Linguistics.
Cite (Informal):
Task Proficiency-Aware Dialogue Analysis in a Real-Time Cooking Game Environment (Nakae & Inaba, SIGDIAL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.sigdial-1.57.pdf