Lexical Redefinition Reveals Context-Sensitive Instruction Following

Roksana Goworek, Haim Dubossarsky


Abstract
How do language models reconcile conflicting contextual evidence within a prompt? We study this question using lexical redefinition, where an explicit instruction specifies how a word should be interpreted and a subsequent sentence provides additional evidence through its usage. Across 870 word pairs, we find that lexical redefinitions are not applied as fixed rules. Instead, the behaviour depends systematically on the relationship between the explicit instruction and the intervening sentence: the contextualised usage can preserve, weaken, or completely reverse the instruction. These results suggest that the interpretation of an explicit instruction remains sensitive to subsequent contextual evidence. Lexical redefinition therefore provides a controlled behavioural paradigm for studying how language models integrate multiple sources of information within a prompt.
Anthology ID:
2026.luhme-1.17
Volume:
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Rui Sousa-Silva, Henrique Lopes Cardoso, Maarit Koponen, Antonio Pareja-Lora
Venues:
LUHME | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
215–226
Language:
URL:
https://aclanthology.org/2026.luhme-1.17/
DOI:
Bibkey:
Cite (ACL):
Roksana Goworek and Haim Dubossarsky. 2026. Lexical Redefinition Reveals Context-Sensitive Instruction Following. In Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026), pages 215–226, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Lexical Redefinition Reveals Context-Sensitive Instruction Following (Goworek & Dubossarsky, LUHME 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.luhme-1.17.pdf