Alper Karamanlioglu
Author directoryAlso published as: Alper Karamanlıoğlu
2026
TÜRKSAT at SHROOM-Visions: Crowd-Emulating Judge Ensembles for Multilingual Hallucination Span Detection in Vision-Language Models
Alper Karamanlioglu | Gökhan Yurtalan | Berkan Demirel
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Alper Karamanlioglu | Gökhan Yurtalan | Berkan Demirel
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
We describe our submission to SHROOM-Visions 2026, the shared task on generator-agnostic, character-level hallucination span detection and typing in vision-language model outputs across English, French, Italian, and Chinese. Rather than training a detector, we use a crowd-emulating judge ensemble: one instruction-tuned multimodal model, sampled at several temperatures and with several prompt variants, independently re-inspects each image, prompt, and response and proposes typed hallucination spans. Character-level vote fractions form soft probabilities that emulate the multi-annotator gold labels, while a cross-validated threshold per language produces hard spans. The black-box system requires no parameter updates and relies on guideline-derived prompt rules and language-specific few-shot examples. On the official closed test set, it ranks first for all English metrics and for Italian IoU, and second for every remaining language-metric combination. Official scores range from 0.4336 to 0.4845 for Cor+Lbl, 0.5474 to 0.5814 for Cor, and 0.4865 to 0.5240 for IoU. On held-out training folds, IoU is 0.32 to 0.39 on non-empty items. Ablations identify prompt design and few-shot conditioning as decisive, while an added adjudication stage does not improve performance. Vote fractions track annotator agreement but remain globally over-confident (ECE 0.08 to 0.12), motivating per-language thresholding.
Building a Turkish Large Language Model via Continual Pre-Training and Parameter-Efficient Adaptation
Alperen Enes Bayar | Mert Ege | Gökhan Yurtalan | Alper Karamanlioglu | Berkan Demirel | Ramazan Gokberk Cinbis
Proceedings of the Second Workshop Natural Language Processing for Turkic Languages (SIGTURK 2026)
Alperen Enes Bayar | Mert Ege | Gökhan Yurtalan | Alper Karamanlioglu | Berkan Demirel | Ramazan Gokberk Cinbis
Proceedings of the Second Workshop Natural Language Processing for Turkic Languages (SIGTURK 2026)
Large Language Models (LLMs) achieve strong performance on many tasks, but they still struggle with morphologically rich, low-resource languages such as Turkish. This difficulty stems from Turkish being an agglutinative language and underrepresented in multilingual training data, which causes current models to often fail at capturing its morphology, flexible word order, and formal registers. In this paper, we introduce MODA (Model Adapted for Domain Applications), a Turkish-specialized LLM built via a modular pipeline that combines continual pre-training, parameter-efficient fine-tuning, and model merging. Starting from Qwen2.5-7B as the base model, we first perform large-scale continual pre-training on a Turkish web corpus to improve grammatical and morphological representations. We then apply parameter-efficient supervised fine-tuning on task-oriented instruction data, and finally merge specialized variants into a single unified model. We evaluate MODA on TurkishMMLU, the Turkish subset of EXAMS, and TRCLAIM-19, where it consistently outperforms both the base and instruction-tuned Qwen2.5-7B models. Our results support a training strategy that explicitly separates linguistic acquisition from task alignment when adapting LLMs to morphologically rich, underrepresented languages under realistic hardware constraints.
2025
A REGNLP Framework: Developing Retrieval-Augmented Generation for Regulatory Document Analysis
Ozan Bayer | Elif Nehir Ulu | Yasemin Sarkın | Ekrem Sütçü | Defne Buse Çelik | Alper Karamanlıoğlu | İsmail Karakaya | Berkan Demirel
Proceedings of the 1st Regulatory NLP Workshop (RegNLP 2025)
Ozan Bayer | Elif Nehir Ulu | Yasemin Sarkın | Ekrem Sütçü | Defne Buse Çelik | Alper Karamanlıoğlu | İsmail Karakaya | Berkan Demirel
Proceedings of the 1st Regulatory NLP Workshop (RegNLP 2025)
This study presents the development of a Retrieval-Augmented Generation (RAG) framework tailored for analyzing regulatory documents from the Abu Dhabi Global Markets (ADGM). The methodology encompasses comprehensive data preprocessing, including extraction, cleaning, and compression of documents, as well as the organization of the ObliQA dataset. The embedding model is utilized for generating embeddings during the retrieval phase, facilitated by the txtai library for managing embeddings and streamlining testing. The training process incorporated innovative strategies such as duplicate recognition, dropout implementation, pooling adjustments, and label modifications to enhance retrieval performance. Hyperparameter tuning further refined the retrieval component, with improvements validated using the recall@10 metric, which measures the proportion of relevant passages among the top-10 results. The refined retrieval component effectively identifies pertinent passages within regulatory documents, expediting information access and supporting compliance efforts.
Enhancing Regulatory Compliance Through Automated Retrieval, Reranking, and Answer Generation
Kübranur Umar | Hakan Doğan | Onur Özcan | İsmail Karakaya | Alper Karamanlıoğlu | Berkan Demirel
Proceedings of the 1st Regulatory NLP Workshop (RegNLP 2025)
Kübranur Umar | Hakan Doğan | Onur Özcan | İsmail Karakaya | Alper Karamanlıoğlu | Berkan Demirel
Proceedings of the 1st Regulatory NLP Workshop (RegNLP 2025)
This paper explains a Retrieval-Augmented Generation (RAG) pipeline that optimizes reg- ularity compliance using a combination of em- bedding models (i.e. bge-m3, jina-embeddings- v3, e5-large-v2) with reranker (i.e. bge- reranker-v2-m3). To efficiently process long context passages, we introduce context aware chunking method. By using the RePASS met- ric, we ensure comprehensive coverage of obli- gations and minimizes contradictions, thereby setting a new benchmark for RAG-based regu- latory compliance systems. The experimen- tal results show that our best configuration achieves a score of 0.79 in Recall@10 and 0.66 in MAP@10 with LLaMA-3.1-8B model for answer generation.
PoliStance-TR: A Dataset for Turkish Stance Detection in Political Domain
Muhammed Cihat Unal | Yasemin Sarkın | Alper Karamanlioglu | Berkan Demirel
Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
Muhammed Cihat Unal | Yasemin Sarkın | Alper Karamanlioglu | Berkan Demirel
Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
Stance detection in NLP involves determining whether an author is supportive, against, or neutral towards a particular target. This task is particularly challenging for Turkish due to the limited availability of data, which hinders progress in the field. To address this issue, we introduce a novel dataset focused on stance detection in Turkish, specifically within the political domain. This dataset was collected from X (formerly Twitter) and annotated by three human annotators who followed predefined guidelines to ensure consistent labeling and generalizability. After compiling the dataset, we trained various transformer-based models with different architectures, showing that the dataset is effective for stance classification. These models achieved an impressive Macro F1 score of up to 82%, highlighting their effectiveness in stance detection.