IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions

Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz Shahar, Jiahuan Pei, Kfir Bar


Abstract
Idioms pose a fundamental challenge for language models, as their meaning cannot be inferred from surface form alone. Understanding such expressions, therefore, requires semantic abstraction beyond lexical overlap. We introduce IdioLink, a retrieval benchmark designed to test whether models can link idiomatic expressions to conceptually equivalent meanings expressed in literal or paraphrased forms. IdioLink comprises 10,700 documents and 2,140 queries, spanning 107 idioms with both literal and figurative uses. Each document and query is annotated with spans that convey the core meaning. Evaluating strong embedding baselines (e.g., BGE, E5, Contriever, and Qwen), we show that current models struggle to retrieve equivalent meanings across divergent surface realizations, relying instead on topical and shallow semantic cues. IdioLink exposes key gaps in idiom-aware semantic retrieval and provides a challenging testbed for future models.
Anthology ID:
2026.emnlp-main.1912
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43554–43573
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1912/
DOI:
Bibkey:
Cite (ACL):
Kai Golan Hashiloni, Daniel Fadlon, Lior Livyatan, Ofri Hefetz Shahar, Jiahuan Pei, and Kfir Bar. 2026. IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 43554–43573, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressions (Hashiloni et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1912.pdf