Conditioning LLMs to Generate Code-Switched Text

Maite Heredia, Gorka Labaka, Jeremy Barnes, Aitor Soroa


Abstract
Code-switching (CS) is still a critical challenge in Natural Language Processing (NLP), due to the limited availability of large-scale, diverse CS datasets for robust training and evaluation. Despite recent advances, the capabilities and limitations of LLMs in handling CS are still not fully understood. In this work, we investigate the extent to which LLMs can be used in a framework for CS text generation, focusing on the English-Spanish language pair. Our proposed methodology consists of back-translating natural CS sentences into monolingual English, and using the resulting parallel corpus to fine-tune LLMs to turn monolingual sentences into CS. We thoroughly analyse the models’ performance through a study on human preferences, a qualitative error analysis, an evaluation with popular reference-based metrics and LLM-based judgment. Results show that fine-tuning can be a key step to ensure that current LLMs consistently generate fluent code-switched text and that our methodology generates high-quality outputs, expanding research opportunities in CS communication. We find that traditional metrics do not correlate with human judgement when assessing the quality of the generated CS data, but LLM-based judgment aligns more closely with human preferences. We release our code and generated dataset under a CC-BY-NC-SA license.
Anthology ID:
2026.lrec-1.703
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
8937–8953
Language:
External URL:
https://lrec.elra.info/lrec2026-main-703
DOI:
10.63317/443bxexszimg
Bibkey:
Cite (ACL):
Maite Heredia, Gorka Labaka, Jeremy Barnes, and Aitor Soroa. 2026. Conditioning LLMs to Generate Code-Switched Text. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 8937–8953, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Conditioning LLMs to Generate Code-Switched Text (Heredia et al., LREC 2026)
Copy Citation: