STaCK: Sentence Ordering with Temporal Commonsense Knowledge

Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya Poria


Abstract
Sentence order prediction is the task of finding the correct order of sentences in a randomly ordered document. Correctly ordering the sentences requires an understanding of coherence with respect to the chronological sequence of events described in the text. Document-level contextual understanding and commonsense knowledge centered around these events are often essential in uncovering this coherence and predicting the exact chronological order. In this paper, we introduce STaCK — a framework based on graph neural networks and temporal commonsense knowledge to model global information and predict the relative order of sentences. Our graph network accumulates temporal evidence using knowledge of ‘past’ and ‘future’ and formulates sentence ordering as a constrained edge classification problem. We report results on five different datasets, and empirically show that the proposed method is naturally suitable for order prediction. The implementation of this work is available at: https://github.com/declare-lab/sentence-ordering.
Anthology ID:
2021.emnlp-main.683
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8676–8686
Language:
URL:
https://aclanthology.org/2021.emnlp-main.683
DOI:
10.18653/v1/2021.emnlp-main.683
Bibkey:
Cite (ACL):
Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, and Soujanya Poria. 2021. STaCK: Sentence Ordering with Temporal Commonsense Knowledge. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 8676–8686, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
STaCK: Sentence Ordering with Temporal Commonsense Knowledge (Ghosal et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.683.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.683.mp4
Code
 declare-lab/sentence-ordering