Light or Full Verb? A Minimal-Pair Dataset for Probing Phraseological Competence in Language Models

Francesca Franzon, Nicolás Rosàs Gómez, Leo Wanner


Abstract
Frequent verbs such as ’have’ and ’make’ can function either as collocates in light-verb constructions or as full lexical predicates, as in ’make a decision’ vs. ’make a cake’. Whether language models represent this distinction, and whether such representations vary across languages, remains unclear. We introduce a large-scale controlled dataset in English, Spanish, and French, comprising minimally varying sentence series in which the same context contains the same verb in light-verb and full-verb uses. Two probing experiments show that language models differentiate between these uses even in minimal contexts and exhibit separable patterns across object types. We release the dataset, generation code, and materials as a reusable resource. The framework supports extensions to broader contexts, additional verbs, and other languages.
Anthology ID:
2026.findings-emnlp.969
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
20499–20512
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.969/
DOI:
Bibkey:
Cite (ACL):
Francesca Franzon, Nicolás Rosàs Gómez, and Leo Wanner. 2026. Light or Full Verb? A Minimal-Pair Dataset for Probing Phraseological Competence in Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 20499–20512, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Light or Full Verb? A Minimal-Pair Dataset for Probing Phraseological Competence in Language Models (Franzon et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.969.pdf