Annotating Temporal Dependency Graphs via Crowdsourcing

Jiarui Yao, Haoling Qiu, Bonan Min, Nianwen Xue


Abstract
We present the construction of a corpus of 500 Wikinews articles annotated with temporal dependency graphs (TDGs) that can be used to train systems to understand temporal relations in text. We argue that temporal dependency graphs, built on previous research on narrative times and temporal anaphora, provide a representation scheme that achieves a good trade-off between completeness and practicality in temporal annotation. We also provide a crowdsourcing strategy to annotate TDGs, and demonstrate the feasibility of this approach with an evaluation of the quality of the annotation, and the utility of the resulting data set by training a machine learning model on this data set. The data set is publicly available.
Anthology ID:
2020.emnlp-main.432
Volume:
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Month:
November
Year:
2020
Address:
Online
Editors:
Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5368–5380
Language:
URL:
https://aclanthology.org/2020.emnlp-main.432
DOI:
10.18653/v1/2020.emnlp-main.432
Bibkey:
Cite (ACL):
Jiarui Yao, Haoling Qiu, Bonan Min, and Nianwen Xue. 2020. Annotating Temporal Dependency Graphs via Crowdsourcing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5368–5380, Online. Association for Computational Linguistics.
Cite (Informal):
Annotating Temporal Dependency Graphs via Crowdsourcing (Yao et al., EMNLP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.emnlp-main.432.pdf