Training free Cross-Modal Alignment for Multilingual Image Retrieval

Usman Shahid, Manan Jain, Natalie Parde


Abstract
We investigate whether multilingual image-text retrieval can be made practical without training a multi-modal model, using frozen multilingual uni-modal encoders and inducing cross-modal alignment through relative representations computed against a large external anchor set. We use English image-caption pairs as anchors and evaluate caption-to-image retrieval on 3,600 images with captions in 36 languages (some low-resource). Across multiple encoder pairings and hyperparameter settings, the method yields usable performance, positioning training-free relative representation as a baseline for multilingual cross-modal alignment when target-language multi-modal training data is unavailable.
Anthology ID:
2026.findings-aacl.203
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4039–4049
Language:
URL:
https://aclanthology.org/2026.findings-aacl.203/
DOI:
Bibkey:
Cite (ACL):
Usman Shahid, Manan Jain, and Natalie Parde. 2026. Training free Cross-Modal Alignment for Multilingual Image Retrieval. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 4039–4049, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Training free Cross-Modal Alignment for Multilingual Image Retrieval (Shahid et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.203.pdf