Align Then Adapt: Label-Efficient Adapter Learning for Asymmetric Dense Retrieval

Seiji Maekawa, Moin Aminnaseri, Pouya Pezeshkpour, Estevam Hruschka


Abstract
Dense retrieval systems increasingly face an asymmetry between complex instruction-like queries and relatively simple, static document collections. While stronger embedders can better understand such queries, re-embedding large corpora or fine-tuning large models is often impractical. We propose Efficient Retrieval Adapter (ERA), a query-side adapter learning framework for re-index-free retrieval adaptation. ERA first aligns the embedding spaces of a strong query embedder and a lightweight document embedder using unlabeled corpus documents, and then adapts the aligned query representation with a small number of labeled query-document pairs. Across 126 MAIR retrieval tasks from six domains, ERA improves average nDCG@10 by up to 8.2 points in symmetric settings and by more than 12 points in asymmetric settings, while using substantially fewer labels than supervised adapter training. These results show that retrieval systems can benefit from stronger query understanding without updating backbone embedders or rebuilding document indexes.
Anthology ID:
2026.emnlp-main.715
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
16595–16610
Language:
URL:
https://aclanthology.org/2026.emnlp-main.715/
DOI:
Bibkey:
Cite (ACL):
Seiji Maekawa, Moin Aminnaseri, Pouya Pezeshkpour, and Estevam Hruschka. 2026. Align Then Adapt: Label-Efficient Adapter Learning for Asymmetric Dense Retrieval. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 16595–16610, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Align Then Adapt: Label-Efficient Adapter Learning for Asymmetric Dense Retrieval (Maekawa et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.715.pdf