Definition-Only RAG for Financial QA: Average Gains and a Diagnostic Boundary

Leyi Ouyang, Edison Marrese-Taylor, Yutaka Matsuo


Abstract
Previous work shows that a model’s ability to define domain terms correlates to performance in other tasks related to that domain. For example, in a QA setting, a language model can miss a question in a specialized domain for no reason other than not properly recalling what a term in the question means. We argue that a short glossary definition is the smallest unit of evidence a retrieval system can supply against that failure. Concretely, focusing on the finance NLP domain, we assess the role of definitions in improving performance on XFinBench, and also pairing MMLU-Finance with a 13,609-term Investopedia glossary of financial terms. We experiment with a five-model panel spanning mid-capability open models to a frontier closed model, and show that definition-only retrieval produces a structured gain on these datasets, with the effect concentrating in a mid-capability band rather than scaling with model size. Finally, we connect term-level measurement to individual questions through a human-validated annotation, and find that term knowledge does not locate the questions where a definition changes the answer, with none our implemented internal routing signals approaching the per-question oracle.
Anthology ID:
2026.findings-emnlp.2448
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52551–52560
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2448/
DOI:
Bibkey:
Cite (ACL):
Leyi Ouyang, Edison Marrese-Taylor, and Yutaka Matsuo. 2026. Definition-Only RAG for Financial QA: Average Gains and a Diagnostic Boundary. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 52551–52560, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Definition-Only RAG for Financial QA: Average Gains and a Diagnostic Boundary (Ouyang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2448.pdf