MESAQA: A Dataset for Multi-Span Contextual and Evidence-Grounded Question Answering

Jui-I Wang, Hen-Hsen Huang, Hsin-Hsi Chen


Abstract
We introduce MESAQA, a novel dataset focusing on multi-span contextual understanding question answering (QA).Unlike traditional single-span QA systems, questions in our dataset consider information from multiple spans within the context document. MESAQA supports evidence-grounded QA, demanding the model’s capability of answer generation and multi-evidence identification. Our automated dataset creation method leverages the MASH-QA dataset and large language models (LLMs) to ensure that each Q/A pair requires considering all selected spans. Experimental results show that current models struggle with multi-span contextual QA, underscoring the need for new approaches. Our dataset sets a benchmark for this emerging QA paradigm, promoting research in complex information retrieval and synthesis.
Anthology ID:
2025.coling-main.724
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10891–10901
Language:
URL:
https://aclanthology.org/2025.coling-main.724/
DOI:
Bibkey:
Cite (ACL):
Jui-I Wang, Hen-Hsen Huang, and Hsin-Hsi Chen. 2025. MESAQA: A Dataset for Multi-Span Contextual and Evidence-Grounded Question Answering. In Proceedings of the 31st International Conference on Computational Linguistics, pages 10891–10901, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
MESAQA: A Dataset for Multi-Span Contextual and Evidence-Grounded Question Answering (Wang et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.724.pdf