Elif Özge Yılmaz
Author directory2026
BIRDTurk: Adaptation of the BIRD Text-to-SQL Dataset to Turkish
Burak Aktaş | Mehmet Can Baytekin | Süha Kağan Köse | Ömer İlbilgi | Elif Özge Yılmaz | Cagri Toraman | Bilge Kaan Görür
Proceedings of the Second Workshop Natural Language Processing for Turkic Languages (SIGTURK 2026)
Burak Aktaş | Mehmet Can Baytekin | Süha Kağan Köse | Ömer İlbilgi | Elif Özge Yılmaz | Cagri Toraman | Bilge Kaan Görür
Proceedings of the Second Workshop Natural Language Processing for Turkic Languages (SIGTURK 2026)
Text-to-SQL systems have achieved strong performance on English benchmarks, yet their behavior in morphologically rich, low-resource languages remains largely unexplored. We introduce BIRDTurk, the first Turkish adaptation of the BIRD benchmark, constructed through a controlled translation pipeline that adapts schema identifiers to Turkish while strictly preserving the logical structure and execution semantics of SQL queries and databases. Translation quality is validated on a sample size determined by the Central Limit Theorem to ensure 95% confidence, achieving 98.15% accuracy on human-evaluated samples. Using BIRDTurk, we evaluate inference-based prompting, agentic multi-stage reasoning, and supervised fine-tuning. Our results reveal that Turkish introduces consistent performance degradation–driven by both structural linguistic divergence and underrepresentation in LLM pretraining–while agentic reasoning demonstrates stronger cross-lingual robustness. Supervised fine-tuning remains challenging for standard multilingual baselines but scales effectively with modern instruction-tuned models. BIRDTurk provides a controlled testbed for cross-lingual Text-to-SQL evaluation under realistic database conditions. We release the training and development splits to support future research.
Impact of Bilingual Corpus on Pretraining Large Language Models: An Analysis for Turkish
Elif Özge Yılmaz | Melike Uysal | Cagri Toraman
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Elif Özge Yılmaz | Melike Uysal | Cagri Toraman
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
The development of Large Language Models has primarily focused on English-centric or massively multilingual paradigms. As a result, the dynamics of mixing just two languages from the very beginning of training remain underexplored, especially for smaller models with limited capacity. In this study, we conduct a controlled set of experiments to evaluate the impact of bilingual corpus during from-scratch pretraining. Using a capacity-constrained Gemma-4-derived 181M-parameter architecture trained on a 10 billion token budget, we compare a purely Turkish baseline against mixtures containing 10%, 20%, or 30% of an auxiliary language. We test four languages to isolate different linguistic relationships: English (a global bridge language), Azerbaijani (closely related sibling), Finnish (morphological peer), and French (lexical pivot). Our findings complicate the curse of multilinguality, the tendency for per-language performance to drop as more languages are added. We show that adding any secondary language hurts fluency on structurally uniform text. However, co-training with a typological sibling, Azerbaijani, cuts perplexity on creative and literary text by up to 45% and 51% respectively relative to the monolingual baseline. At higher mixture ratios, Azerbaijani outperforms other languages including morphological and lexical alternatives.