Analysis of Dialogue in Human-Human Collaboration in Minecraft

Takuma Ichikawa, Ryuichiro Higashinaka


Abstract
Recently, many studies have focused on developing dialogue systems that enable collaborative work; however, they rarely focus on creative tasks. Collaboration for creative work, in which humans and systems collaborate to create new value, will be essential for future dialogue systems. In this study, we collected 500 dialogues of human-human collaboration in Minecraft as a basis for developing a dialogue system that enables creative collaborative work. We conceived the Collaborative Garden Task, where two workers interact and collaborate in Minecraft to create a garden, and we collected dialogue, action logs, and subjective evaluations. We also collected third-person evaluations of the gardens and analyzed the relationship between dialogue and collaborative work that received high scores on the subjective and third-person evaluations in order to identify dialogic factors for high-quality collaborative work. We found that two essential aspects in creative collaborative work are performing more processes to ask for and agree on suggestions between workers and agreeing on a particular image of the final product in the early phase of work and then discussing changes and details.
Anthology ID:
2022.lrec-1.431
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
4051–4059
Language:
URL:
https://aclanthology.org/2022.lrec-1.431
DOI:
Bibkey:
Cite (ACL):
Takuma Ichikawa and Ryuichiro Higashinaka. 2022. Analysis of Dialogue in Human-Human Collaboration in Minecraft. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 4051–4059, Marseille, France. European Language Resources Association.
Cite (Informal):
Analysis of Dialogue in Human-Human Collaboration in Minecraft (Ichikawa & Higashinaka, LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.431.pdf