NELSR: A Nepali Legal Benchmark for Case-to-Statute Retrieval

Anjan Parajuli, Darshan Kunwar


Abstract
Legal professionals spend considerable time identifying statutes relevant to legal cases by navigating lengthy and hierarchically structured legal documents. While automated statute retrieval has advanced for high-resource languages to resolve the problem, the Nepali legal domain still lacks a standardized benchmark for realistic case-to-statute retrieval and systematic evaluation. To address this gap, we introduce NELSR (Nepali Legal Statute Retrieval Benchmark), comprising 5,731 case-derived queries extracted from Supreme Court judgments and a corpus of 302 federal statutes. NELSR is constructed using a citation-aware query construction approach that establishes reliable query–statute relevance pairs and legal structure-aware segmentation to preserve the semantic and hierarchical organization of statutory units. We establish retrieval baselines by evaluating sparse, dense, and hybrid retrieval methods and investigate the contributions of lexical and semantic retrieval signals through ablation studies. Experimental results show that hybrid retrieval achieves the best performance, with a Recall@100 of 0.66, nDCG@10 of 0.34, and MRR@10 of 0.32.
Anthology ID:
2026.nllp-1.43
Volume:
Proceedings of the Natural Legal Language Processing Workshop 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Nikolaos Aletras, Ilias Chalkidis, Leslie Barrett, Cătălina Goanță, Daniel Preoțiuc-Pietro, Gerasimos Spanakis, Shanshan Xu
Venues:
NLLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
524–534
Language:
URL:
https://aclanthology.org/2026.nllp-1.43/
DOI:
Bibkey:
Cite (ACL):
Anjan Parajuli and Darshan Kunwar. 2026. NELSR: A Nepali Legal Benchmark for Case-to-Statute Retrieval. In Proceedings of the Natural Legal Language Processing Workshop 2026, pages 524–534, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
NELSR: A Nepali Legal Benchmark for Case-to-Statute Retrieval (Parajuli & Kunwar, NLLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nllp-1.43.pdf