Seorin Kim
Author directory2026
KBS: A Korean Benchmark Suite for Foundation Model Evaluation
Yeonkyoung So | Jongmin Kim | Sungmok Jung | Gyuseong Lee | Sangho Kim | Jongyeon Park | Joonhak Lee | Seho Pyo | Gyeongje Cho | Seorin Kim | Jisoo Kim | Suyoung Park | Hyunji M. Park | Yelim Ahn | Yeongho Seo | Jaejin Lee
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Yeonkyoung So | Jongmin Kim | Sungmok Jung | Gyuseong Lee | Sangho Kim | Jongyeon Park | Joonhak Lee | Seho Pyo | Gyeongje Cho | Seorin Kim | Jisoo Kim | Suyoung Park | Hyunji M. Park | Yelim Ahn | Yeongho Seo | Jaejin Lee
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
We present a Korean Benchmark Suite (KBS) comprising Ko-ARC, Ko-GSM8K, Ko-EQ-Bench, Ko-WinoGrande, Ko-LAMBADA, and Ko-IFEval, covering six capabilities across 9,396 items. The suite combines review, localization, direct Korean construction, and redesign for Korean, avoiding a translation-only approach to benchmark adaptation. We evaluate Korean-developed models, multilingual open models, and closed API models under protocols that account for model access, prompt format, and scoring differences. Results show that Korean benchmark scores depend on task construction, scoring rules, prompting, and model post-training. These findings suggest that Korean evaluation should report both final scores and the settings used to obtain them.
2025
KLAAD: Refining Attention Mechanisms to Reduce Societal Bias in Generative Language Models
Seorin Kim | Dongyoung Lee | Jaejin Lee
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Seorin Kim | Dongyoung Lee | Jaejin Lee
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) often exhibit societal biases in their outputs, prompting ethical concerns regarding fairness and harm. In this work, we propose KLAAD (KL-Attention Alignment Debiasing), an attention-based debiasing framework that implicitly aligns attention distributions between stereotypical and anti-stereotypical sentence pairs without directly modifying model weights. KLAAD introduces a composite training objective combining Cross-Entropy, KL divergence, and Triplet losses, guiding the model to consistently attend across biased and unbiased contexts while preserving fluency and coherence. Experimental evaluation of KLAAD demonstrates improved bias mitigation on both the BBQ and BOLD benchmarks, with minimal impact on language modeling quality. The results indicate that attention-level alignment offers a principled solution for mitigating bias in generative language models.