STQA: A Benchmark for Stock-Focused Tabular Question Answering over Historical and Forecasted Data

Baoxu An, Wenmian Yang, Zhensheng Wang, Weijia Jia


Abstract
Stock market analysis inherently requires composite reasoning over historical records and future projections, yet existing benchmarks remain fragmented across isolated tasks. We introduce STQA (Stock-focused Tabular Question Answering), an end-to-end benchmark designed to systematically evaluate natural-language question answering over historical data, numerical forecasts, and forecast-based reasoning. Built on a large-scale financial dataset, STQA covers 4,451 stocks and contains 30,500 question–answer pairs derived from expert-crafted templates, accompanied by fine-grained intent and slot annotations. To operationalize this benchmark, we present SQFRS (Stock Query–Forecast–Reasoning System), an agent-based unified framework that orchestrates SQL retrieval and time-series forecasting tools. Experiments demonstrate that while current large language models perform well on historical queries, forecast-based reasoning poses a substantial challenge, revealing critical bottlenecks in tool coordination and reasoning under uncertainty.
Anthology ID:
2026.findings-emnlp.869
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
18364–18387
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.869/
DOI:
Bibkey:
Cite (ACL):
Baoxu An, Wenmian Yang, Zhensheng Wang, and Weijia Jia. 2026. STQA: A Benchmark for Stock-Focused Tabular Question Answering over Historical and Forecasted Data. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 18364–18387, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
STQA: A Benchmark for Stock-Focused Tabular Question Answering over Historical and Forecasted Data (An et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.869.pdf