Dispersing the clouds of doubt: can cosine similarity of word embeddings help identify relation-level metaphors in Slovene?

Mojca Brglez


Abstract
Word embeddings and pre-trained language models have achieved great performance in many tasks due to their ability to capture both syntactic and semantic information in their representations. The vector space representations have also been used to identify figurative language shifts such as metaphors, however, the more recent contextualized models have mostly been evaluated via their performance on downstream tasks. In this article, we evaluate static and contextualized word embeddings in terms of their representation and unsupervised identification of relation-level (ADJ-NOUN, NOUN-NOUN) metaphors in Slovene on a set of 24 literal and 24 metaphorical phrases. Our experiments show very promising results for both embedding methods, however, the performance in contextual embeddings notably depends on the layer involved and the input provided to the model.
Anthology ID:
2023.bsnlp-1.8
Volume:
Proceedings of the 9th Workshop on Slavic Natural Language Processing 2023 (SlavicNLP 2023)
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Jakub Piskorski, Michał Marcińczuk, Preslav Nakov, Maciej Ogrodniczuk, Senja Pollak, Pavel Přibáň, Piotr Rybak, Josef Steinberger, Roman Yangarber
Venue:
BSNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
61–69
Language:
URL:
https://aclanthology.org/2023.bsnlp-1.8
DOI:
10.18653/v1/2023.bsnlp-1.8
Bibkey:
Cite (ACL):
Mojca Brglez. 2023. Dispersing the clouds of doubt: can cosine similarity of word embeddings help identify relation-level metaphors in Slovene?. In Proceedings of the 9th Workshop on Slavic Natural Language Processing 2023 (SlavicNLP 2023), pages 61–69, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Dispersing the clouds of doubt: can cosine similarity of word embeddings help identify relation-level metaphors in Slovene? (Brglez, BSNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.bsnlp-1.8.pdf
Video:
 https://aclanthology.org/2023.bsnlp-1.8.mp4