Can Pre-trained Language Models Interpret Similes as Smart as Human?

Qianyu He, Sijie Cheng, Zhixu Li, Rui Xie, Yanghua Xiao


Abstract
Simile interpretation is a crucial task in natural language processing. Nowadays, pre-trained language models (PLMs) have achieved state-of-the-art performance on many tasks. However, it remains under-explored whether PLMs can interpret similes or not. In this paper, we investigate the ability of PLMs in simile interpretation by designing a novel task named Simile Property Probing, i.e., to let the PLMs infer the shared properties of similes. We construct our simile property probing datasets from both general textual corpora and human-designed questions, containing 1,633 examples covering seven main categories. Our empirical study based on the constructed datasets shows that PLMs can infer similes’ shared properties while still underperforming humans. To bridge the gap with human performance, we additionally design a knowledge-enhanced training objective by incorporating the simile knowledge into PLMs via knowledge embedding methods. Our method results in a gain of 8.58% in the probing task and 1.37% in the downstream task of sentiment classification. The datasets and code are publicly available at https://github.com/Abbey4799/PLMs-Interpret-Simile.
Anthology ID:
2022.acl-long.543
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Smaranda Muresan, Preslav Nakov, Aline Villavicencio
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7875–7887
Language:
URL:
https://aclanthology.org/2022.acl-long.543
DOI:
10.18653/v1/2022.acl-long.543
Bibkey:
Cite (ACL):
Qianyu He, Sijie Cheng, Zhixu Li, Rui Xie, and Yanghua Xiao. 2022. Can Pre-trained Language Models Interpret Similes as Smart as Human?. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7875–7887, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Can Pre-trained Language Models Interpret Similes as Smart as Human? (He et al., ACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.acl-long.543.pdf
Code
 abbey4799/plms-interpret-simile