Jinwon Kim
Author directory2026
GRACE: Generating Conflict-Aware Cases for Evaluating Policy Compliance in Enterprise Conversational AI
Jinwon Kim | Kyunghyun Lim | Gayeon Kim | Sookeun Yun | Min-Oh Heo
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Jinwon Kim | Kyunghyun Lim | Gayeon Kim | Sookeun Yun | Min-Oh Heo
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Policy compliance in enterprise conversational AI is not binary: the same response can satisfy one stakeholder’s policy while violating another’s. Existing evaluations largely treat compliance as a single-policy problem, which makes cross-role conflict cases difficult to construct and assess. GRACE (Generating Conflict-Aware Cases for Evaluating Policy Compliance) addresses this gap by generating matched normal and conflict cases from the same underlying scenario, assigning role-wise expected verdicts through independent per-role policy evaluation, and scoring responses independently for each role rather than collapsing compliance into a single binary label. Across four domains, this process yields 1,109 labeled scenarios, including 309 cross-role conflicts. Evaluating five LLMs shows that deny cases are easiest, allow cases are depressed by over-refusal, and conflict cases are consistently hardest, revealing failures that single-label evaluation obscures. Per-persona analysis further shows that these errors are localized to specific domain-role combinations rather than uniform across models. GRACE therefore supports both policy review and deployment-time model selection.
2025
End-to-End Multilingual Automatic Dubbing via Duration-based Translation with Large Language Models
Hyun-Sik Won | DongJin Jeong | Hyunkyu Choi | Jinwon Kim
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Hyun-Sik Won | DongJin Jeong | Hyunkyu Choi | Jinwon Kim
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Automatic dubbing (AD) aims to replace the original speech in a video with translated speech that maintains precise temporal alignment (isochrony). Achieving natural synchronization between dubbed speech and visual content remains challenging due to variations in speech durations across languages. To address this, we propose an end-to-end AD framework that leverages large language models (LLMs) to integrate translation and timing control seamlessly. At the core of our framework lies Duration-based Translation (DT), a method that dynamically predicts the optimal phoneme count based on source speech duration and iteratively adjusts the translation length accordingly. Our experiments on English, Spanish, and Korean language pairs demonstrate that our approach substantially improves speech overlap—achieving up to 24% relative gains compared to translations without explicit length constraints—while maintaining competitive translation quality measured by COMET scores. Furthermore, our framework does not require language-specific tuning, ensuring practicality for multilingual dubbing scenarios.