MaDOVE: a Dataset for Multilingual Document VQA Evaluation

Elio Musacchio, Lucia Siciliani, Pierpaolo Basile, Giovanni Semeraro, Mark Federico Zampedroni, Asia Beatrice Uboldi


Abstract
Visual Question Answering (VQA) is one of the most popular tasks in the fields of Computer Vision and Natural Language Processing. The task is to provide an answer to a question related to the contents of a given image. VQA has been expanded to several domains. One of these is document VQA, where the image is a page of a document and the question is related to the textual contents of the page. In this case, the system that is being evaluated has to understand textual contents that are written inside the image, differently from typical VQA where images are natural scenes. However, document VQA datasets are exclusively in English, hence the performance of the system is evaluated for the English language only. In light of this, we introduce MaDOVE (Multilingual DOcument VQA Evaluation), a novel dataset designed to evaluate document VQA in multiple languages. Moreover, to establish a strong benchmark, we conduct an extensive set of experiments by evaluating a diverse range of models on this task.
Anthology ID:
2026.docinsights-1.28
Volume:
The Proceedings of Workshop on Document Intelligence and Understanding
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Santosh T.Y.S.S., Amit Agarwal, Vivek Gupta, Yova Kementchedjhieva, Aparna Garimella, Yufang Hou
Venues:
DocInsights | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
409–427
Language:
URL:
https://aclanthology.org/2026.docinsights-1.28/
DOI:
Bibkey:
Cite (ACL):
Elio Musacchio, Lucia Siciliani, Pierpaolo Basile, Giovanni Semeraro, Mark Federico Zampedroni, and Asia Beatrice Uboldi. 2026. MaDOVE: a Dataset for Multilingual Document VQA Evaluation. In The Proceedings of Workshop on Document Intelligence and Understanding, pages 409–427, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MaDOVE: a Dataset for Multilingual Document VQA Evaluation (Musacchio et al., DocInsights 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.docinsights-1.28.pdf