Cross-lingual Named Entity Corpus for Slavic Languages

Jakub Piskorski, Michał Marcińczuk, Roman Yangarber


Abstract
This paper presents a corpus manually annotated with named entities for six Slavic languages — Bulgarian, Czech, Polish, Slovenian, Russian, and Ukrainian. This work is the result of a series of shared tasks, conducted in 2017–2023 as a part of the Workshops on Slavic Natural Language Processing. The corpus consists of 5,017 documents on seven topics. The documents are annotated with five classes of named entities. Each entity is described by a category, a lemma, and a unique cross-lingual identifier. We provide two train-tune dataset splits — single topic out and cross topics. For each split, we set benchmarks using a transformer-based neural network architecture with the pre-trained multilingual models — XLM-RoBERTa-large for named entity mention recognition and categorization, and mT5-large for named entity lemmatization and linking.
Anthology ID:
2024.lrec-main.369
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
4143–4157
Language:
URL:
https://aclanthology.org/2024.lrec-main.369
DOI:
Bibkey:
Cite (ACL):
Jakub Piskorski, Michał Marcińczuk, and Roman Yangarber. 2024. Cross-lingual Named Entity Corpus for Slavic Languages. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 4143–4157, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Cross-lingual Named Entity Corpus for Slavic Languages (Piskorski et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.369.pdf