Incorporating Circumstances into Narrative Event Prediction

Shichao Wang, Xiangrui Cai, HongBin Wang, Xiaojie Yuan


Abstract
The narrative event prediction aims to predict what happens after a sequence of events, which is essential to modeling sophisticated real-world events. Existing studies focus on mining the inter-events relationships while ignoring how the events happened, which we called circumstances. With our observation, the event circumstances indicate what will happen next. To incorporate event circumstances into the narrative event prediction, we propose the CircEvent, which adopts the two multi-head attention to retrieve circumstances at the local and global levels. We also introduce a regularization of attention weights to leverage the alignment between events and local circumstances. The experimental results demonstrate our CircEvent outperforms existing baselines by 12.2%. The further analysis demonstrates the effectiveness of our multi-head attention modules and regularization.
Anthology ID:
2021.findings-emnlp.416
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2021
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
4840–4849
Language:
URL:
https://aclanthology.org/2021.findings-emnlp.416
DOI:
10.18653/v1/2021.findings-emnlp.416
Bibkey:
Cite (ACL):
Shichao Wang, Xiangrui Cai, HongBin Wang, and Xiaojie Yuan. 2021. Incorporating Circumstances into Narrative Event Prediction. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 4840–4849, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Incorporating Circumstances into Narrative Event Prediction (Wang et al., Findings 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.findings-emnlp.416.pdf
Video:
 https://aclanthology.org/2021.findings-emnlp.416.mp4