Enhancing and Evaluating Tabular Models on the Fly via Synthetic Question–Answer Generation

Jorge Osés Grijalba, Eugenio Martínez Cámara, L. Alfonso Ureñ-López, Jose Camacho-Collados


Abstract
Question Answering (QA) over Tabular Data has been traditionally a challenging task, but LLMs have recently shown the ability to respond to questions related to this type of structured data. However, current tabular QA datasets are skewed toward Wikipedia tables and SQL-style answers composed of human-crafted question–answer pairs. This limits the evaluation of LLMs on this task to a narrow genre of data and language, while also requiring extensive human effort for dataset or benchmark creation. To address this, we introduce SynTabQA, a methodology for the automatic generation of synthetic question–answer pairs from any unannotated table. SynTabQA defines a detailed question typology, enabling fine-grained evaluation and facilitating the creation of diverse QA datasets. Our approach not only provides an automated test bed for any tabular dataset but can also be used in few-shot settings to supply LLMs with tailored examples, improving their focus and accuracy. We validate SynTabQA on two large, manually constructed tabular QA benchmarks of distinct nature.
Anthology ID:
2026.lrec-1.421
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
5389–5413
Language:
External URL:
https://lrec.elra.info/lrec2026-main-421
DOI:
10.63317/27e3cist39z2
Bibkey:
Cite (ACL):
Jorge Osés Grijalba, Eugenio Martínez Cámara, L. Alfonso Ureñ-López, and Jose Camacho-Collados. 2026. Enhancing and Evaluating Tabular Models on the Fly via Synthetic Question–Answer Generation. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 5389–5413, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Enhancing and Evaluating Tabular Models on the Fly via Synthetic Question–Answer Generation (Osés Grijalba et al., LREC 2026)
Copy Citation: