MICE: Minimal Interaction Cross-Encoders for efficient Re-ranking

Mathias Vast, Victor Morand, Josiane Mothe, Benjamin Piwowarski


Abstract
In Information Retrieval (IR), cross-encoders deliver state-of-the-art ranking effectiveness but have a high inference cost, limiting their use to second-stage re-rankers. Prior work has addressed this bottleneck from two largely separate directions: accelerating cross-encoder inference through attention sparsification, or improving first-stage retrieval effectiveness to alleviate the need of a re-ranker, using more complex models, e.g. late-interactions. In this work, we bridge these two directions through an in-depth analysis of cross-encoder internal mechanisms. By identifying and removing superfluous interactions, we derive MICE (Minimal Interaction Cross-Encoders), a new cross-encoder architecture that retains effectiveness while reducing computational overhead. Extensive evaluations show MICE retains most of the performances of its cross-encoder counterparts in-domain and matches or even exceeds it in out-of-domain, while reducing FLOPs down to 2.5 times.
Anthology ID:
2026.emnlp-main.1736
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
39612–39628
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1736/
DOI:
Bibkey:
Cite (ACL):
Mathias Vast, Victor Morand, Josiane Mothe, and Benjamin Piwowarski. 2026. MICE: Minimal Interaction Cross-Encoders for efficient Re-ranking. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 39612–39628, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MICE: Minimal Interaction Cross-Encoders for efficient Re-ranking (Vast et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1736.pdf