Few-shot Semantic Recovery Attacks on Image Embeddings

Yiyi Chen, Qiongkai Xu, Johannes Bjerva


Abstract
Image embeddings are an essential commodity in modern AI: stored at scale in vector databases, transferred between edge devices and cloud APIs, and traded as paid services. Image embeddings have been implicitly treated as anonymous—an assumption that has not been rigorously tested even as embedding services scale to billions of stored vectors. _We show this assumption breaks._ We propose **C**ross-modal **R**ecovery **A**ttack with **F**ew-shot **T**ransfer (**CRAFT**), a framework that recovers semantic meaning, including free-form captions and sensitive attributes. The attack focuses on the medical domain and facial features, targeting black-box image embeddings without reconstructing a single image in pixels and without any knowledge of the underlying model architecture, training data, or weights. **CRAFT** combines a public dual-encoder, a linear alignment learned from intercepted image-embedding pairs, and a fine-tuned embedding-to-text decoder; we further strengthen recovery with two augmentative techniques: cross-modal reranking against the attacker’s text encoder and chain-of-thought prompting on a diffusion-rendered low-fidelity reconstruction of the leaked embedding. Attacks succeed with as few as a single intercepted pair and transfer across five open-source and proprietary embedders. We disclose a privacy surface that current defenses cannot close. Every setting that preserves downstream utility also leaves the attack effective. Black-box image embeddings, as widely deployed in AI systems today, should not be treated as privacy-preserving artifacts.[We open source our code for reproducibility and further research: <https://github.com/siebeniris/CRAFT>.]
Anthology ID:
2026.emnlp-main.2368
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
53745–53767
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2368/
DOI:
Bibkey:
Cite (ACL):
Yiyi Chen, Qiongkai Xu, and Johannes Bjerva. 2026. Few-shot Semantic Recovery Attacks on Image Embeddings. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 53745–53767, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Few-shot Semantic Recovery Attacks on Image Embeddings (Chen et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2368.pdf