ChartTableViVQA: A Vietnamese Benchmark Dataset for Visual Question Answering with Reasoning Instruction over Charts and Tables Images

Quang Nhat Truong, Pham Quoc Thang, Son T. Luu


Abstract
Visual Question Answering (VQA) over charts and tables requires joint reasoning over language, visual structure, and numerical information, yet no standard benchmark currently exists for Vietnamese. We introduce ChartTableViVQA, a Vietnamese VQA dataset with 13,003 question–answer–instruction triplets over 868 chart and table images. Questions cover multiple reasoning types, ranging from simple value lookup to multi-step aggregation, comparison, and trend analysis, and are accompanied by concise instructions that explicitly guide the reasoning process. The dataset is built via a semi-automatic human-in-the-loop pipeline, combining large language model generation with manual verification by Vietnamese annotators. We evaluate several vision-language models in zero-shot and instruction-based settings. Results show strong performance on simple questions but clear weaknesses in complex reasoning, particularly on charts, while instruction-based prompting consistently improves accuracy.
Anthology ID:
2026.aacl-long.5
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
99–123
Language:
URL:
https://aclanthology.org/2026.aacl-long.5/
DOI:
Bibkey:
Cite (ACL):
Quang Nhat Truong, Pham Quoc Thang, and Son T. Luu. 2026. ChartTableViVQA: A Vietnamese Benchmark Dataset for Visual Question Answering with Reasoning Instruction over Charts and Tables Images. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 99–123, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
ChartTableViVQA: A Vietnamese Benchmark Dataset for Visual Question Answering with Reasoning Instruction over Charts and Tables Images (Truong et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.5.pdf