Retrieval for Legal AI: Complementarity and Cross-Collection Interference in Brazilian Legal Collections

Flavio Soriano, Guilherme Henrique Gomes Evangelista, Celso França, Gisele L. Pappa, Wagner Meira Jr., Marcos André Gonçalves


Abstract
Modern Legal AI systems rely on retrieval to ground answers in heterogeneous sources, including precedents, normative acts, legislative proposals, and explanatory materials. We study retrieval across five Brazilian legal collections, evaluated separately and in a pooled global index, using lexical, dense, fusion, and generative reranking architectures. The union of BM25 and dense top-10 results covers 55.4–60.3% of judged positives, 2.7–3.4 percentage points more than the better individual retriever, demonstrating substantial lexical–semantic complementarity. Reciprocal Rank Fusion (RRF) exploits part of this complementarity, but a per-query selector oracle consistently outperforms it, indicating that the preferred retrieval signal varies across queries. Pooling the collections reduces NDCG@10 by 18.5–25.9% under the original source-local judgments, showing substantial degradation when the relevant source is not known in advance; exact duplicates account for only a small fraction of this measured loss. RRF remains the strongest fixed first-stage architecture, yet we find no evidence that its gains are preserved after generative reranking at the dataset-macro level, indicating that stronger first-stage retrieval does not necessarily translate into better final rankings. These findings characterize heterogeneous legal retrieval as a multi-stage problem of source selection, signal selection, and evidence promotion.
Anthology ID:
2026.nllp-1.31
Volume:
Proceedings of the Natural Legal Language Processing Workshop 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Nikolaos Aletras, Ilias Chalkidis, Leslie Barrett, Cătălina Goanță, Daniel Preoțiuc-Pietro, Gerasimos Spanakis, Shanshan Xu
Venues:
NLLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
350–360
Language:
URL:
https://aclanthology.org/2026.nllp-1.31/
DOI:
Bibkey:
Cite (ACL):
Flavio Soriano, Guilherme Henrique Gomes Evangelista, Celso França, Gisele L. Pappa, Wagner Meira Jr., and Marcos André Gonçalves. 2026. Retrieval for Legal AI: Complementarity and Cross-Collection Interference in Brazilian Legal Collections. In Proceedings of the Natural Legal Language Processing Workshop 2026, pages 350–360, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Retrieval for Legal AI: Complementarity and Cross-Collection Interference in Brazilian Legal Collections (Soriano et al., NLLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nllp-1.31.pdf