Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for Catalan

Roser Saurí, Josep Sànchez-Ferreres, Lluis Padro, Josep Carmona


Abstract
Small Language Models (SLMs), typically ranging from a few million to 10–15 billion parameters, offer a promising solution towards constraints imposed by platform size–particularly mobile and IoT devices–and by the requirements of many organizations such as SMEs, which need solutions that ensure data privacy while remaining cost-effective. Their compactness and efficiency provide digital sovereignty and flexibility, though with more limited general-purpose capabilities. This makes them especially sensitive when working with underrepresented languages, such as Catalan, due to interference from majority languages that can increase bias risk. This paper evaluates state-of-the-art SLMs in a real-world Catalan use case: an AI assistant for older adults, assessing both user interactions and structured function call generation. Our work, which contributes to the Anonymized-Project initiative for deploying a connected SLM-based infrastructure under the Model Context Protocol, demonstrates that some SLMs are able to deliver high-quality performance even in resource-constrained, linguistically minority environments.
Anthology ID:
2026.sigul-1.27
Volume:
Proceedings of the SIGUL 2026 Joint Workshop with ELE, EURALI, and DCLRL: Towards Inclusivity and Equality: Language Resources and Technologies for Under-Resourced and Endangered Languages
Month:
May
Year:
2026
Address:
Palma, Mallorca, Spain
Editors:
Atul Kr. Ojha, Sakriani Sakti, Claudia Soria, Maite Melero, John P. McCrae, Constantine Lignos, Chao-Hong Liu, German Rigau Claramunt, Georg Rehm
Venues:
SIGUL | EURALI | DCLRL | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
270–279
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-sigul-27
DOI:
10.63317/4qn4qiyiwuze
Bibkey:
Cite (ACL):
Roser Saurí, Josep Sànchez-Ferreres, Lluis Padro, and Josep Carmona. 2026. Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for Catalan. In Proceedings of the SIGUL 2026 Joint Workshop with ELE, EURALI, and DCLRL: Towards Inclusivity and Equality: Language Resources and Technologies for Under-Resourced and Endangered Languages, pages 270–279, Palma, Mallorca, Spain. ELRA Language Resources Association (ELRA).
Cite (Informal):
Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for Catalan (Saurí et al., SIGUL-EURALI-DCLRL 2026)
Copy Citation: