RunyaNER: Auxiliary Language Selection for Runyankore NER

Prosper Arineitwe Asiimwe, Francois Meyer, Jan Buys


Abstract
Cross-lingual zero-shot transfer and multilingual fine-tuning are promising approaches for NLP tasks such as Named Entity Recognition (NER) in low-resource languages, but in the absence of target language benchmarks, it is unclear which auxiliary language selection strategy leads to the best transfer. We introduce RunyaNER, the first publicly available NER benchmark for the East African language Runyankore, and use it to investigate the choice of which languages to use for transfer. Created with a semi-automated pipeline and fully manually verified, RunyaNER contains over 237k annotated words across 30k sentences. We benchmark pretrained models on RunyaNER, establishing that our dataset is of sufficient quality and size to produce effective Runyankore NER models. We then use RunyaNER to investigate auxiliary language selection in cross-lingual zero-shot and multilingual fine-tuning settings. Our experiments show that while transfer performance is highly sensitive to auxiliary language selection, embedding-based measures computed from labelled training spans correlate more strongly with downstream transfer performance than traditional linguistic features based on metadata or typology. By releasing RunyaNER and providing a systematic analysis of auxiliary language selection strategies, this work contributes both a new benchmark resource and practical insights for multilingual transfer in low-resource settings.
Anthology ID:
2026.mrl-1.38
Volume:
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
David Ifeoluwa Adelani, Jesujoba Alabi, Catherine Arnett, Tyler Chang, C.M. Downey, Omer Goldman, Senyu Li, Lester James Validad Miranda, Jirui Qi, David Stap, Genta Indra Winata, Xinyu Crystina Zhang
Venues:
MRL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
480–491
Language:
URL:
https://aclanthology.org/2026.mrl-1.38/
DOI:
Bibkey:
Cite (ACL):
Prosper Arineitwe Asiimwe, Francois Meyer, and Jan Buys. 2026. RunyaNER: Auxiliary Language Selection for Runyankore NER. In Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026), pages 480–491, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
RunyaNER: Auxiliary Language Selection for Runyankore NER (Asiimwe et al., MRL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mrl-1.38.pdf