LEAF: Linguistically Enhanced Event Temporal Relation Framework

Stanley Lim, Da Yin, Nanyun Peng


Abstract
Linguistic structures can implicitly imply diverse types of event relations that have been previously underexplored. For example, the sentence “John was cooking freshly made noodles for the family gathering” contains no explicit temporal indicators between the events, such as before. Despite this, it is easy for humans to conclude, based on syntax, that the noodles were made before John started cooking, and that the family gathering starts after John starts cooking. We introduce Linguistically enhanced Event TemporAl relation Framework (LEAF), a simple and effective approach to acquiring rich temporal knowledge of events from large-scale corpora. This method improves pre-trained language models by automatically extracting temporal relation knowledge from unannotated corpora using diverse temporal knowledge patterns. We begin by manually curating a comprehensive list of atomic patterns that imply temporal relations between events. These patterns involve event pairs in which one event is contained within the argument of the other. Using transitivity, we discover compositional patterns and assign labels to event pairs involving these patterns. Finally, we make language models learn the rich knowledge by pre-training with the acquired temporal relation supervision. Experiments show that our method outperforms or rivals previous models on two event relation datasets: MATRES and TB-Dense. Our approach is also simpler from past works and excels at identifying complex compositional event relations.
Anthology ID:
2023.pandl-1.2
Volume:
Proceedings of the 2nd Workshop on Pattern-based Approaches to NLP in the Age of Deep Learning
Month:
December
Year:
2023
Address:
Singapore
Editors:
Mihai Surdeanu, Ellen Riloff, Laura Chiticariu, Dayne Frietag, Gus Hahn-Powell, Clayton T. Morrison, Enrique Noriega-Atala, Rebecca Sharp, Marco Valenzuela-Escarcega
Venues:
PANDL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6–19
Language:
URL:
https://aclanthology.org/2023.pandl-1.2
DOI:
10.18653/v1/2023.pandl-1.2
Bibkey:
Cite (ACL):
Stanley Lim, Da Yin, and Nanyun Peng. 2023. LEAF: Linguistically Enhanced Event Temporal Relation Framework. In Proceedings of the 2nd Workshop on Pattern-based Approaches to NLP in the Age of Deep Learning, pages 6–19, Singapore. Association for Computational Linguistics.
Cite (Informal):
LEAF: Linguistically Enhanced Event Temporal Relation Framework (Lim et al., PANDL-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.pandl-1.2.pdf
Video:
 https://aclanthology.org/2023.pandl-1.2.mp4