Understanding Mention Detector-Linker Interaction in Neural Coreference Resolution

Zhaofeng Wu, Matt Gardner


Abstract
Despite significant recent progress in coreference resolution, the quality of current state-of-the-art systems still considerably trails behind human-level performance. Using the CoNLL-2012 and PreCo datasets, we dissect the best instantiation of the mainstream end-to-end coreference resolution model that underlies most current best-performing coreference systems, and empirically analyze the behavior of its two components: mention detector and mention linker. While the detector traditionally focuses heavily on recall as a design decision, we demonstrate the importance of precision, calling for their balance. However, we point out the difficulty in building a precise detector due to its inability to make important anaphoricity decisions. We also highlight the enormous room for improving the linker and show that the rest of its errors mainly involve pronoun resolution. We propose promising next steps and hope our findings will help future research in coreference resolution.
Anthology ID:
2021.crac-1.16
Volume:
Proceedings of the Fourth Workshop on Computational Models of Reference, Anaphora and Coreference
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Maciej Ogrodniczuk, Sameer Pradhan, Massimo Poesio, Yulia Grishina, Vincent Ng
Venue:
CRAC
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
150–157
Language:
URL:
https://aclanthology.org/2021.crac-1.16
DOI:
10.18653/v1/2021.crac-1.16
Bibkey:
Cite (ACL):
Zhaofeng Wu and Matt Gardner. 2021. Understanding Mention Detector-Linker Interaction in Neural Coreference Resolution. In Proceedings of the Fourth Workshop on Computational Models of Reference, Anaphora and Coreference, pages 150–157, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Understanding Mention Detector-Linker Interaction in Neural Coreference Resolution (Wu & Gardner, CRAC 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.crac-1.16.pdf
Video:
 https://aclanthology.org/2021.crac-1.16.mp4
Data
PreCo