Fin-DBQA Shared-task: Database Querying and Reasoning

Rungsiman Nararatwong, Natthawut Kertkeidkachorn, Hiroya Takamura, Ryutaro Ichise


Abstract
This paper presents the results of the Fin-DBQA shared task based on a question-answering dataset, focusing on database querying and reasoning. The dataset, consisting of 400 questions grouped into 40 conversations, evaluates language models’ abilities to answer sequential questions with complex reasoning and multi-hop queries in a multi-turn conversational question-answering setting. Each sample includes the question, answer, database queries, querying result (tables), and a program (series of operations) that produces the answer from the result. We received 52 submissions from three participants, with scores significantly surpassing the baselines. One participant submitted a paper detailing a prompt-based solution using large language models with additional data preprocessing that helps improve the overall performance.
Anthology ID:
2025.finnlp-1.44
Volume:
Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on Large Language Models for Finance and Legal (LLMFinLegal)
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Chung-Chi Chen, Antonio Moreno-Sandoval, Jimin Huang, Qianqian Xie, Sophia Ananiadou, Hsin-Hsi Chen
Venues:
FinNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
385–391
Language:
URL:
https://aclanthology.org/2025.finnlp-1.44/
DOI:
Bibkey:
Cite (ACL):
Rungsiman Nararatwong, Natthawut Kertkeidkachorn, Hiroya Takamura, and Ryutaro Ichise. 2025. Fin-DBQA Shared-task: Database Querying and Reasoning. In Proceedings of the Joint Workshop of the 9th Financial Technology and Natural Language Processing (FinNLP), the 6th Financial Narrative Processing (FNP), and the 1st Workshop on Large Language Models for Finance and Legal (LLMFinLegal), pages 385–391, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Fin-DBQA Shared-task: Database Querying and Reasoning (Nararatwong et al., FinNLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.finnlp-1.44.pdf