Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution

Connor Baumler, Rachel Rudinger


Abstract
As using they/them as personal pronouns becomes increasingly common in English, it is important that coreference resolution systems work as well for individuals who use personal “they” as they do for those who use gendered personal pronouns. We introduce a new benchmark for coreference resolution systems which evaluates singular personal “they” recognition. Using these WinoNB schemas, we evaluate a number of publicly available coreference resolution systems and confirm their bias toward resolving “they” pronouns as plural.
Anthology ID:
2022.naacl-main.250
Volume:
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Marine Carpuat, Marie-Catherine de Marneffe, Ivan Vladimir Meza Ruiz
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3426–3432
Language:
URL:
https://aclanthology.org/2022.naacl-main.250
DOI:
10.18653/v1/2022.naacl-main.250
Bibkey:
Cite (ACL):
Connor Baumler and Rachel Rudinger. 2022. Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 3426–3432, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution (Baumler & Rudinger, NAACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.naacl-main.250.pdf
Video:
 https://aclanthology.org/2022.naacl-main.250.mp4
Code
 ctbaumler/winonb
Data
WinoNBGAP Coreference DatasetGICorefWSCWinoBiasWinogender Schemas