Geometric Representations of African Languages: A Regional Semantic Hub and Cultural Steering

Muhammad Abdullahi Said, Jonathan P. Shock


Abstract
We study how Gemma 4 31B represents African languages and responds to cultural steering. The first study compares nine African languages and three controls using probes, contrast directions, and measures of representation similarity. Transfer from English varies across languages and layers. Directions representing an Africa versus West contrast are more aligned among the African languages than between these languages and the controls at several layers. The comparison across language families passes the reported Holm threshold at five of twelve layers, although dependence between language pairs limits the statistical interpretation. Within Nigeria, Yoruba and Igbo are more aligned than the average of their pairs with Hausa at eleven of twelve layers. The second study uses separate English data to construct directions for Nigeria, Ghana, Kenya, and South Africa. Under union scoring at the selected strengths, estimated differences in attribution rates from random directions range from 0.63 to 0.81. Most outputs pass the automated structural coherence screen. Comparisons with Aya Expanse 32B show that results depend on the representation measure. Together, the studies document regional and family patterns in the sampled representations and country steering in English.
Anthology ID:
2026.mrl-1.18
Volume:
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
David Ifeoluwa Adelani, Jesujoba Alabi, Catherine Arnett, Tyler Chang, C.M. Downey, Omer Goldman, Senyu Li, Lester James Validad Miranda, Jirui Qi, David Stap, Genta Indra Winata, Xinyu Crystina Zhang
Venues:
MRL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
230–244
Language:
URL:
https://aclanthology.org/2026.mrl-1.18/
DOI:
Bibkey:
Cite (ACL):
Muhammad Abdullahi Said and Jonathan P. Shock. 2026. Geometric Representations of African Languages: A Regional Semantic Hub and Cultural Steering. In Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026), pages 230–244, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Geometric Representations of African Languages: A Regional Semantic Hub and Cultural Steering (Said & Shock, MRL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mrl-1.18.pdf