Edits in the Wild: A Multilingual Benchmark for Localizing On-Device Generative Image Edits on Consumer Platforms

Mohd. Farhan Israk Soumik, Awal Ahmed Fime, Malithi Mithsara Wanniarachchi Kankanamge, Arun Babu Aryal, Hoda Joudi Haghighi, Bibek Koirala, Ahmed Imteaj, Abdur R. Shahid


Abstract
Consumer devices now ship with generative image editing tools that can remove objects, move subjects, and create new visual content directly on phones, tablets, and laptops. Yet current benchmarks largely miss this setting: real on-device edits produced by black-box consumer generative AI editing tools, with variation across platforms, devices, edit operations, and post-edit compression. We introduce ConsumerGenEdit, a large-scale multilingual benchmark for language-guided localization of on-device generative image edits. The dataset contains 4,000 royalty-free source images and 48,000 manually edited images created on Apple, Google, and Samsung devices, covering object removal, object movement, and sketch-based object generation. To study robustness under realistic sharing conditions, we add 144,000 learned-compression variants at three quality levels. Each example includes platform, device, editing operation, compression metadata, bounding-box annotations, and edit descriptions in English, Bangla, and Persian/Farsi generated with five vision-language models (VLMs). We evaluate five separate benchmark VLMs on edit detection and edit-operation classification. By focusing on where and how consumer AI edits occur, rather than only whether an image is synthetic, ConsumerGenEdit provides a practical testbed for multilingual VLM grounding, image provenance, and robust interpretation of AI-edited media.
Anthology ID:
2026.emnlp-main.1661
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
37756–37789
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1661/
DOI:
Bibkey:
Cite (ACL):
Mohd. Farhan Israk Soumik, Awal Ahmed Fime, Malithi Mithsara Wanniarachchi Kankanamge, Arun Babu Aryal, Hoda Joudi Haghighi, Bibek Koirala, Ahmed Imteaj, and Abdur R. Shahid. 2026. Edits in the Wild: A Multilingual Benchmark for Localizing On-Device Generative Image Edits on Consumer Platforms. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 37756–37789, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Edits in the Wild: A Multilingual Benchmark for Localizing On-Device Generative Image Edits on Consumer Platforms (Soumik et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1661.pdf