LMs stand their Ground: Investigating the Effect of Embodiment in Figurative Language Interpretation by Language Models

Philipp Wicke


Abstract
Figurative language is a challenge for language models since its interpretation is based on the use of words in a way that deviates from their conventional order and meaning. Yet, humans can easily understand and interpret metaphors, similes or idioms as they can be derived from embodied metaphors. Language is a proxy for embodiment and if a metaphor is conventional and lexicalised, it becomes easier for a system without a body to make sense of embodied concepts. Yet, the intricate relation between embodiment and features such as concreteness or age of acquisition has not been studied in the context of figurative language interpretation concerning language models. Hence, the presented study shows how larger language models perform better at interpreting metaphoric sentences when the action of the metaphorical sentence is more embodied. The analysis rules out multicollinearity with other features (e.g. word length or concreteness) and provides initial evidence that larger language models conceptualise embodied concepts to a degree that facilitates figurative language understanding.
Anthology ID:
2023.findings-acl.302
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4899–4913
Language:
URL:
https://aclanthology.org/2023.findings-acl.302
DOI:
10.18653/v1/2023.findings-acl.302
Bibkey:
Cite (ACL):
Philipp Wicke. 2023. LMs stand their Ground: Investigating the Effect of Embodiment in Figurative Language Interpretation by Language Models. In Findings of the Association for Computational Linguistics: ACL 2023, pages 4899–4913, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
LMs stand their Ground: Investigating the Effect of Embodiment in Figurative Language Interpretation by Language Models (Wicke, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.302.pdf
Video:
 https://aclanthology.org/2023.findings-acl.302.mp4