Findings of the Shared Task on Multilingual Coreference Resolution

Zdeněk Žabokrtský, Miloslav Konopík, Anna Nedoluzhko, Michal Novák, Maciej Ogrodniczuk, Martin Popel, Ondřej Pražák, Jakub Sido, Daniel Zeman, Yilun Zhu


Abstract
This paper presents an overview of the shared task on multilingual coreference resolution associated with the CRAC 2022 workshop. Shared task participants were supposed to develop trainable systems capable of identifying mentions and clustering them according to identity coreference. The public edition of CorefUD 1.0, which contains 13 datasets for 10 languages, was used as the source of training and evaluation data. The CoNLL score used in previous coreference-oriented shared tasks was used as the main evaluation metric. There were 8 coreference prediction systems submitted by 5 participating teams; in addition, there was a competitive Transformer-based baseline system provided by the organizers at the beginning of the shared task. The winner system outperformed the baseline by 12 percentage points (in terms of the CoNLL scores averaged across all datasets for individual languages).
Anthology ID:
2022.crac-mcr.1
Volume:
Proceedings of the CRAC 2022 Shared Task on Multilingual Coreference Resolution
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Editors:
Zdeněk Žabokrtský, Maciej Ogrodniczuk
Venue:
CRAC
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–17
Language:
URL:
https://aclanthology.org/2022.crac-mcr.1
DOI:
Bibkey:
Cite (ACL):
Zdeněk Žabokrtský, Miloslav Konopík, Anna Nedoluzhko, Michal Novák, Maciej Ogrodniczuk, Martin Popel, Ondřej Pražák, Jakub Sido, Daniel Zeman, and Yilun Zhu. 2022. Findings of the Shared Task on Multilingual Coreference Resolution. In Proceedings of the CRAC 2022 Shared Task on Multilingual Coreference Resolution, pages 1–17, Gyeongju, Republic of Korea. Association for Computational Linguistics.
Cite (Informal):
Findings of the Shared Task on Multilingual Coreference Resolution (Žabokrtský et al., CRAC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.crac-mcr.1.pdf
Code
 ufal/corefud-scorer
Data
ParCorFull