Yelim Ahn
Author directory2026
Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding
Sungmok Jung | Yeonkyoung So | Joonhak Lee | Sangho Kim | Yelim Ahn | Jaejin Lee
Findings of the Association for Computational Linguistics: ACL 2026
Sungmok Jung | Yeonkyoung So | Joonhak Lee | Sangho Kim | Yelim Ahn | Jaejin Lee
Findings of the Association for Computational Linguistics: ACL 2026
Although negation is known to challenge large language models (LLMs), benchmarks for evaluating negation understanding—especially in Korean—are scarce. We conduct a corpus-based analysis of Korean negation and show that LLM performance degrades under negation. We then introduce Thunder-KoNUBench, a sentence-level negation understanding benchmark that reflects the empirical distribution of Korean negation phenomena. Evaluating 47 LLMs on Thunder-KoNUBench, we analyze the effects of model size and instruction tuning, and perform error analysis to better understand model behavior. We further show that fine-tuning on Thunder-KoNUBench improves negation understanding and broader contextual comprehension in Korean.
KBS: A Korean Benchmark Suite for Foundation Model Evaluation
Yeonkyoung So | Jongmin Kim | Sungmok Jung | Gyuseong Lee | Sangho Kim | Jongyeon Park | Joonhak Lee | Seho Pyo | Gyeongje Cho | Seorin Kim | Jisoo Kim | Suyoung Park | Hyunji M. Park | Yelim Ahn | Yeongho Seo | Jaejin Lee
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Yeonkyoung So | Jongmin Kim | Sungmok Jung | Gyuseong Lee | Sangho Kim | Jongyeon Park | Joonhak Lee | Seho Pyo | Gyeongje Cho | Seorin Kim | Jisoo Kim | Suyoung Park | Hyunji M. Park | Yelim Ahn | Yeongho Seo | Jaejin Lee
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
We present a Korean Benchmark Suite (KBS) comprising Ko-ARC, Ko-GSM8K, Ko-EQ-Bench, Ko-WinoGrande, Ko-LAMBADA, and Ko-IFEval, covering six capabilities across 9,396 items. The suite combines review, localization, direct Korean construction, and redesign for Korean, avoiding a translation-only approach to benchmark adaptation. We evaluate Korean-developed models, multilingual open models, and closed API models under protocols that account for model access, prompt format, and scoring differences. Results show that Korean benchmark scores depend on task construction, scoring rules, prompting, and model post-training. These findings suggest that Korean evaluation should report both final scores and the settings used to obtain them.