CuRLRank: Adaptive Curriculum Reinforcement Learning for Reasoning-Intensive Reranking

Xin Kang, Yunxiao Zhao, Jiayang Zhang, Juncai Li, Zhichao Yan, XiaoQi Han, Ru Li, Delvin Ce Zhang


Abstract
Document ranking aims to order candidate documents based on their relevance to a given query. However, identifying relevant documents in complex real-world scenarios requires deep reasoning beyond surface-level matching, driving a shift from semantic matching to reasoning-intensive reranking. Since the latter requires integrating information across documents for complex reasoning, it presents two key challenges: (1) varying reasoning difficulty, where assessing document relevance to the query requires multi-step reasoning with different complexity; and (2) strong contextual sensitivity, where the relevance of a document is heavily influenced by other documents within the context window. To address these challenges, we propose CuRLRank, which consists of (1) CuRL, an adaptive curriculum reinforcement learning approach that enables LLMs to develop complex reasoning capabilities across varying levels of difficulty, and (2) IFRS, an iterative filtering ranking strategy to achieve efficient and robust ranking. Extensive experiments on BRIGHT and R2MED benchmarks demonstrate that our CuRLRank significantly outperforms baseline methods while achieving lower ranking latency.
Anthology ID:
2026.emnlp-main.1868
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
42563–42592
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1868/
DOI:
Bibkey:
Cite (ACL):
Xin Kang, Yunxiao Zhao, Jiayang Zhang, Juncai Li, Zhichao Yan, XiaoQi Han, Ru Li, and Delvin Ce Zhang. 2026. CuRLRank: Adaptive Curriculum Reinforcement Learning for Reasoning-Intensive Reranking. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 42563–42592, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CuRLRank: Adaptive Curriculum Reinforcement Learning for Reasoning-Intensive Reranking (Kang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1868.pdf