The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue

Sherzod Hakimov, Mattia D’Agostini, Ivan Samodelkin, David Schlangen


Abstract
We introduce the Image Reconstruction Game, a fully automated benchmark in which a vision-language model issues corrective instructions to an image generator across multiple turns, making accumulated common ground directly observable as a rendered image. Benchmarking two Describer models crossed with two Generator models across seven image categories, we find that the describer is the dominant factor in reconstruction quality, while the generator determines whether iterative refinement helps or hurts. Mathematical and geometric images pose the greatest challenge. The describer’s token budget strongly affects convergence: shorter budgets yield sparser first renderings with more room for visible improvement, while longer budgets raise absolute quality but leave less to fix. Stronger describers use a richer correction vocabulary spanning spatial, numeric, and structural categories, while weaker describers concentrate on surface properties and tend to stop after a few turns. Human validation shows that the best automated judge reaches only slight-to-fair agreement with human preferences, and automated scores require human recalibration to be used reliably.
Anthology ID:
2026.findings-aacl.131
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2561–2583
Language:
URL:
https://aclanthology.org/2026.findings-aacl.131/
DOI:
Bibkey:
Cite (ACL):
Sherzod Hakimov, Mattia D’Agostini, Ivan Samodelkin, and David Schlangen. 2026. The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 2561–2583, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue (Hakimov et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.131.pdf