FSTs vs ICL: Generalisation in LLMs for an under-resourced language

Ximena Gutierrez, Mikel Segura Elizalde, Victor Mijangos


Abstract
LLMs have been widely adopted to tackle many traditional NLP tasks. Their effectiveness remains uncertain in scenarios where pre-trained models have limited prior knowledge of a language. In this work, we examine LLMs’ generalization in under-resourced settings through the task of orthographic normalization across Otomi language variants. We develop two approaches: a rule-based method using a finite-state transducer (FST) and an in-context learning (ICL) method that provides the model with string transduction examples. We compare the performance of FSTs and neural approaches in low-resource scenarios, providing insights into their potential and limitations. Our results show that while FSTs outperform LLMs in zero-shot settings, ICL enables LLMs to surpass FSTs, stressing the importance of combining linguistic expertise with machine learning in current approaches for low-resource scenarios.
Anthology ID:
2025.findings-emnlp.867
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15998–16006
Language:
URL:
https://aclanthology.org/2025.findings-emnlp.867/
DOI:
Bibkey:
Cite (ACL):
Ximena Gutierrez, Mikel Segura Elizalde, and Victor Mijangos. 2025. FSTs vs ICL: Generalisation in LLMs for an under-resourced language. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 15998–16006, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
FSTs vs ICL: Generalisation in LLMs for an under-resourced language (Gutierrez et al., Findings 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.findings-emnlp.867.pdf
Checklist:
 2025.findings-emnlp.867.checklist.pdf