What GPT-4 Knows about Aspectual Coercion: Focused on “Begin the Book”

Seohyun Im, Chungmin Lee


Abstract
This paper explores whether Pre-trained Large Language Models (PLLMs) like GPT-4 can grasp profound linguistic insights into language phenomena such as Aspectual Coercion through interaction with Microsoft’s Copilot, which integrates GPT-4. Firstly, we examined Copilot’s understanding of the co-occurrence constraints of the aspectual verb “begin” and the complex-type noun “book” using the classic illustration of Aspectual Coercion, “begin the book.” Secondly, we verified Copilot’s awareness of both the default interpretation of “begin the book” with no specific context and the contextually preferred interpretation. Ultimately, Copilot provided appropriate responses regarding potential interpretations of “begin the book” based on its distributional properties and context-dependent preferred interpretations. However, it did not furnish sophisticated explanations concerning these interpretations from a linguistic theoretical perspective. On the other hand, by offering diverse interpretations grounded in distributional properties, language models like GPT-4 demonstrated their potential contribution to the refinement of linguistic theories. Furthermore, we suggested the feasibility of employing Language Models to construct language resources associated with language phenomena including Aspectual Coercion.
Anthology ID:
2024.cogalex-1.7
Volume:
Proceedings of the Workshop on Cognitive Aspects of the Lexicon @ LREC-COLING 2024
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Michael Zock, Emmanuele Chersoni, Yu-Yin Hsu, Simon de Deyne
Venue:
CogALex
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
56–67
Language:
URL:
https://aclanthology.org/2024.cogalex-1.7
DOI:
Bibkey:
Cite (ACL):
Seohyun Im and Chungmin Lee. 2024. What GPT-4 Knows about Aspectual Coercion: Focused on “Begin the Book”. In Proceedings of the Workshop on Cognitive Aspects of the Lexicon @ LREC-COLING 2024, pages 56–67, Torino, Italia. ELRA and ICCL.
Cite (Informal):
What GPT-4 Knows about Aspectual Coercion: Focused on “Begin the Book” (Im & Lee, CogALex 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.cogalex-1.7.pdf