Priberam Labs at the 3rd Shared Task on SlavNER

Pedro Ferreira, Ruben Cardoso, Afonso Mendes


Abstract
This document describes our participation at the 3rd Shared Task on SlavNER, part of the 8th Balto-Slavic Natural Language Processing Workshop, where we focused exclusively in the Named Entity Recognition (NER) task. We addressed this task by combining multi-lingual contextual embedding models, such as XLM-R (Conneau et al., 2020), with character- level embeddings and a biaffine classifier (Yu et al., 2020). This allowed us to train downstream models for NER using all the available training data. We are able to show that this approach results in good performance when replicating the scenario of the 2nd Shared Task.
Anthology ID:
2021.bsnlp-1.10
Volume:
Proceedings of the 8th Workshop on Balto-Slavic Natural Language Processing
Month:
April
Year:
2021
Address:
Kiyv, Ukraine
Editors:
Bogdan Babych, Olga Kanishcheva, Preslav Nakov, Jakub Piskorski, Lidia Pivovarova, Vasyl Starko, Josef Steinberger, Roman Yangarber, Michał Marcińczuk, Senja Pollak, Pavel Přibáň, Marko Robnik-Šikonja
Venue:
BSNLP
SIG:
SIGSLAV
Publisher:
Association for Computational Linguistics
Note:
Pages:
86–92
Language:
URL:
https://aclanthology.org/2021.bsnlp-1.10
DOI:
Bibkey:
Cite (ACL):
Pedro Ferreira, Ruben Cardoso, and Afonso Mendes. 2021. Priberam Labs at the 3rd Shared Task on SlavNER. In Proceedings of the 8th Workshop on Balto-Slavic Natural Language Processing, pages 86–92, Kiyv, Ukraine. Association for Computational Linguistics.
Cite (Informal):
Priberam Labs at the 3rd Shared Task on SlavNER (Ferreira et al., BSNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.bsnlp-1.10.pdf