EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking

Enjun Du, Siyi Liu, Zirong Chen, Xinyu Zuo, Jinwen Luo, Ruiwen Tao, Lisheng Duan, Haijin Liang, Jin Ma, Junfu Pu, Yongqi Zhang


Abstract
Real-world image search queries are multimodal and compositional: “find this shirt in pink” specifies an entity to retain, an attribute to modify, and context to ignore. Yet existing re-rankers either compress such multi-faceted relevance into an opaque embedding or rely on free-form chain-of-thought that easily omits or hallucinates fine-grained constraints. Drawing on rubric- and checklist-based evaluation from NLP, we recast multimodal image re-ranking as a semantic constraint satisfaction problem and propose EviRank, which parses any query—text-only, image-only, or composed—into a unified evidence package: typed criteria across six semantic slots (e.g., entities, attributes, relations), each labelled required, forbidden, or ignorable. Re-ranking then reduces to evidence-conditioned verification, combining deterministic rubric scoring and evidence-grounded listwise comparison in a single training-free procedure. The explicit evidence can further serve as structured supervision for optionally distilling a lightweight student. Across five benchmarks spanning text-to-image, image-to-image, and composed image retrieval, EviRank achieves state-of-the-art performance, and the distilled student preserves over 90% of the teacher’s capability at substantially lower cost.
Anthology ID:
2026.emnlp-main.332
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
7640–7666
Language:
URL:
https://aclanthology.org/2026.emnlp-main.332/
DOI:
Bibkey:
Cite (ACL):
Enjun Du, Siyi Liu, Zirong Chen, Xinyu Zuo, Jinwen Luo, Ruiwen Tao, Lisheng Duan, Haijin Liang, Jin Ma, Junfu Pu, and Yongqi Zhang. 2026. EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 7640–7666, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking (Du et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.332.pdf