FinLCR: Scaling Financial Long-Context Reasoning via Curriculum Reinforcement Learning

Wenjie Qiu, Yong Xie, Karan Aggarwal, Aitzaz Ahmad, Stephen Lau


Abstract
Long-context financial document understanding and reasoning pose significant challenges for small language models (SLMs). In this paper, we scale the financial long-context reasoning capability of SLMs through reinforcement learning. Specifically, we propose an efficient curriculum reinforcement learning recipe that features staged training across context lengths and difficulty-aware data sampling. To support our curriculum recipe, we curate Fin-Ladder, a difficulty-graded financial corpus spanning diverse datasets and context lengths. We apply the proposed corpus and recipe to train Financial Long-Context Reasoner (FinLCR), a 4-billion parameter model with enhanced financial reasoning capabilities. Experiments demonstrate that our curriculum learning recipe yields superior performance on financial numerical reasoning benchmarks.
Anthology ID:
2026.finnlp-1.3
Volume:
Proceedings of the 11th Workshop on Financial Technology and Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jimin Huang, Yongjae Lee, Sophia Ananiadou, Hsin-Hsi Chen, Hiroya Takamura, Chung-Chi Chen
Venues:
FinNLP | WS
SIG:
SIGFinTech
Publisher:
Association for Computational Linguistics
Note:
Pages:
15–25
Language:
URL:
https://aclanthology.org/2026.finnlp-1.3/
DOI:
Bibkey:
Cite (ACL):
Wenjie Qiu, Yong Xie, Karan Aggarwal, Aitzaz Ahmad, and Stephen Lau. 2026. FinLCR: Scaling Financial Long-Context Reasoning via Curriculum Reinforcement Learning. In Proceedings of the 11th Workshop on Financial Technology and Natural Language Processing, pages 15–25, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FinLCR: Scaling Financial Long-Context Reasoning via Curriculum Reinforcement Learning (Qiu et al., FinNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.finnlp-1.3.pdf