Sunkyoung Kim
Author directory2026
BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs
Sangyeon Yoon | Hyesoo Hong | Wonje Jeung | Yongil Kim | Wooseok Seo | Heuiyeen Yeen | Albert No | Sunkyoung Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Sangyeon Yoon | Hyesoo Hong | Wonje Jeung | Yongil Kim | Wooseok Seo | Heuiyeen Yeen | Albert No | Sunkyoung Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However, in third-party communication settings governed by social and institutional norms, some user preferences may be inappropriate to apply. We introduce BenchPreS, which evaluates whether memory-based user preferences are appropriately applied or suppressed across communication contexts. Using two complementary metrics, Misapplication Rate (MR) and Appropriate Application Rate (AAR), we find even frontier LLMs struggle to apply preferences in a context-sensitive manner. Models with stronger preference adherence exhibit higher rates of over-application, and neither reasoning capability nor selectivity-oriented prompting fully resolve this issue. These results suggest that current LLMs treat preferences as globally enforceable rules rather than as context-dependent normative signals.
2025
From KMMLU-Redux to Pro: A Professional Korean Benchmark Suite for LLM Evaluation
Seokhee Hong | Sunkyoung Kim | Guijin Son | Soyeon Kim | Yeonjung Hong | Jinsik Lee
Findings of the Association for Computational Linguistics: EMNLP 2025
Seokhee Hong | Sunkyoung Kim | Guijin Son | Soyeon Kim | Yeonjung Hong | Jinsik Lee
Findings of the Association for Computational Linguistics: EMNLP 2025
The development of Large Language Models (LLMs) requires robust benchmarks that encompass not only academic domains but also industrial fields to effectively evaluate their applicability in real-world scenarios. In this paper, we introduce two Korean expert-level benchmarks. KMMLU-Redux, reconstructed from the existing KMMLU consists of questions from the Korean National Technical Qualification exams, with critical errors removed to enhance reliability. KMMLU-Pro is based on Korean National Professional Licensure exams to reflect professional knowledge in Korea. Our experiments demonstrate that these benchmarks comprehensively represent industrial knowledge in Korea.