BenCoref: A Multi-Domain Dataset of Nominal Phrases and Pronominal Reference Annotations

Shadman Rohan, Mojammel Hossain, Mohammad Rashid, Nabeel Mohammed


Abstract
Coreference Resolution is a well studied problem in NLP. While widely studied for English and other resource-rich languages, research on coreference resolution in Bengali largely remains unexplored due to the absence of relevant datasets. Bengali, being a low-resource language, exhibits greater morphological richness compared to English. In this article, we introduce a new dataset, BenCoref, comprising coreference annotations for Bengali texts gathered from four distinct domains. This relatively small dataset contains 5200 mention annotations forming 502 mention clusters within 48,569 tokens. We describe the process of creating this dataset and report performance of multiple models trained using BenCoref. We anticipate that our work sheds some light on the variations in coreference phenomena across multiple domains in Bengali and encourages the development of additional resources for Bengali. Furthermore, we found poor crosslingual performance at zero-shot setting from English, highlighting the need for more language-specific resources for this task.
Anthology ID:
2023.law-1.11
Volume:
Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Jakob Prange, Annemarie Friedrich
Venue:
LAW
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
104–117
Language:
URL:
https://aclanthology.org/2023.law-1.11
DOI:
10.18653/v1/2023.law-1.11
Bibkey:
Cite (ACL):
Shadman Rohan, Mojammel Hossain, Mohammad Rashid, and Nabeel Mohammed. 2023. BenCoref: A Multi-Domain Dataset of Nominal Phrases and Pronominal Reference Annotations. In Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII), pages 104–117, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
BenCoref: A Multi-Domain Dataset of Nominal Phrases and Pronominal Reference Annotations (Rohan et al., LAW 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.law-1.11.pdf