Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing

Shafiuddin Rehan Ahmed, Zhiyong Wang, George Baker, Kevin Stowe, James Martin


Abstract
The most popular Cross-Document Event Coreference Resolution (CDEC) datasets fail to convey the true difficulty of the task, due to the lack of lexical diversity between coreferring event triggers (words or phrases that refer to an event). Furthermore, there is a dearth of event datasets for figurative language, limiting a crucial avenue of research in event comprehension. We address these two issues by introducing ECB+META, a lexically rich variant of Event Coref Bank Plus (ECB+) for CDEC on symbolic and metaphoric language. We use ChatGPT as a tool for the metaphoric transformation of sentences in the documents of ECB+, then tag the original event triggers in the transformed sentences in a semi-automated manner. In this way, we avoid the re-annotation of expensive coreference links. We present results that show existing methods that work well on ECB+ struggle with ECB+META, thereby paving the way for CDEC research on a much more challenging dataset. Code/data: https://github.com/ahmeshaf/llms_coref
Anthology ID:
2024.acl-short.27
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
276–286
Language:
URL:
https://aclanthology.org/2024.acl-short.27
DOI:
Bibkey:
Cite (ACL):
Shafiuddin Rehan Ahmed, Zhiyong Wang, George Baker, Kevin Stowe, and James Martin. 2024. Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 276–286, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing (Ahmed et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-short.27.pdf