Jeewon Yang
Author directory2026
K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance
Eunbyeol Cho | Yunseung Lee | Mirae Kim | Jeewon Yang | Youngjun Kwak | Edward Choi
Findings of the Association for Computational Linguistics: EMNLP 2026
Eunbyeol Cho | Yunseung Lee | Mirae Kim | Jeewon Yang | Youngjun Kwak | Edward Choi
Findings of the Association for Computational Linguistics: EMNLP 2026
Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barrier to deployment in high-stakes environments. Existing benchmarks focus on single-turn, English-centric tasks, leaving the multi-turn dynamics and linguistic-regulatory nuances of the Korean financial domain unaddressed. We introduce K-FinHallu, the first benchmark for hallucination detection in multi-turn Korean financial RAG, designed as a controlled evaluation of source faithfulness and answerability. We construct multi-turn dialogues from authentic Korean financial documents and inject hallucinations under a proposed hierarchical taxonomy based on context answerability that explicitly accounts for justified abstention. Benchmarking Korean-centric, open-source, and closed-source LLMs as hallucination detectors, we find that even the strongest models struggle with fine-grained financial diagnostics and refusal behavior. While fine-tuning an 8B model on our training split yields performance competitive with frontier LLMs, justified abstention remains the weakest axis across all evaluated models. K-FinHallu and code are publicly available at https://github.com/eunbyeol-cho/K-FinHallu.