AfriSUD: A Dependency Treebank Collection for Evaluating Models on African Languages

Happy Buzaaba, Cheikh Mouhamadou Bamba Dione, David Ifeoluwa Adelani, Sylvain Kahane, Bruno Guillaume, Kim Gerdes, Shamsuddeen Hassan Muhammad, Kevin Guan, Anuoluwapo Aremu, Naome A Etori, Utitofon Inyang, Peter Nabende, David Sabiiti Bamutura, Andiswa Bukula, Idris Akinade, Chinedu Uchechukwu, Rooweither Mabuya, Christiane Fellbaum


Abstract
Despite their linguistic diversity and global significance, African languages remain underrepresented in research and resources to support NLP. We aim to bridge this gap by introducing AfriSUD, the first multilingual collection of syntactically annotated treebanks for nine diverse African languages spanning major language families and regions across Sub-Saharan Africa. Using the Surface-Syntactic Universal Dependencies (SUD) framework, our community-led effort provides high-quality, native-speaker-verified data that capture typological key features such as agglutination and tone. We evaluate a range of models on AfriSUD for part-of-speech tagging and dependency parsing, including non-transformer baselines, multilingual pretrained encoders, and LLMs. Our results reveal a significant syntax gap, where models still show clear limitations across the nine languages, suggesting that existing architectures may not fully capture the structural diversity of African-language syntax.
Anthology ID:
2026.emnlp-main.1896
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43227–43248
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1896/
DOI:
Bibkey:
Cite (ACL):
Happy Buzaaba, Cheikh Mouhamadou Bamba Dione, David Ifeoluwa Adelani, Sylvain Kahane, Bruno Guillaume, Kim Gerdes, Shamsuddeen Hassan Muhammad, Kevin Guan, Anuoluwapo Aremu, Naome A Etori, Utitofon Inyang, Peter Nabende, David Sabiiti Bamutura, Andiswa Bukula, Idris Akinade, Chinedu Uchechukwu, Rooweither Mabuya, and Christiane Fellbaum. 2026. AfriSUD: A Dependency Treebank Collection for Evaluating Models on African Languages. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 43227–43248, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AfriSUD: A Dependency Treebank Collection for Evaluating Models on African Languages (Buzaaba et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1896.pdf