Yubin Choi
Author directory2026
AtlasNLP: A Country-Aware Atlas of Dataset Representation in NLP
Joan Nwatu | Tsedeniya Solomon Amare | Longju Bai | Bontu Fufa Balcha | Zayd Bashir | Angana Borah | Zara Burzo | Yubin Choi | Naihao Deng | Samika Gupta | Michel Faloughi | Claude Kwizera | Ziqiao Ma | Cynthia Yacel Fuertes Panizo | Ellie Seehorn | Hui Shen | Jiayi Tang | Zesen Zhao | Boyuan Zheng | Rada Mihalcea
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Joan Nwatu | Tsedeniya Solomon Amare | Longju Bai | Bontu Fufa Balcha | Zayd Bashir | Angana Borah | Zara Burzo | Yubin Choi | Naihao Deng | Samika Gupta | Michel Faloughi | Claude Kwizera | Ziqiao Ma | Cynthia Yacel Fuertes Panizo | Ellie Seehorn | Hui Shen | Jiayi Tang | Zesen Zhao | Boyuan Zheng | Rada Mihalcea
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Understanding which countries are represented in NLP datasets is essential for identifying gaps, targeting data collection, measuring progress, and informing AI policy. However, geographic metadata is very rarely available, and country-level representation is often hidden behind broad language-level claims. We introduce **AtlasNLP**, a country-aware atlas of over 13,000 NLP dataset records across normalized NLP task categories, tracking both the populations represented and where datasets are produced. AtlasNLP includes **AtlasNLP-Gold**, a human-curated reference set, and **AtlasNLP-Core**, an ACL-derived large-scale collection. Using this resource, we show that (1) dataset coverage is highly uneven across countries and tasks; (2) dataset production and representation are geographically asymmetric; and (3) language coverage does not imply geographic representation. These findings reveal blind spots in current dataset documentation practices and motivate more explicit geographic metadata for country-aware NLP evaluation.
FinHarmBench: Financial Jailbreak Benchmark and Unsupervised Safety Fine-Tuning via Refusal Steering Distillation
Yubin Choi | Yujin Yang | Subin Kim | Seokil Ham | Seungju Cho | Jungmin Son | Youngjun Kwak | Changick Kim
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Yubin Choi | Yujin Yang | Subin Kim | Seokil Ham | Seungju Cho | Jungmin Son | Youngjun Kwak | Changick Kim
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Financial Large Language Models (LLMs) exhibit strong domain expertise but remain vulnerable to financially harmful prompts. To systematically assess this vulnerability, we introduce FinHarmBench, a benchmark designed to evaluate financially harmful and confusable benign prompts. Our analysis reveals a concerning result that financial LLMs can be less robust than general-purpose models, suggesting that domain adaptation alone does not guarantee financial safety alignment. To address this issue, we propose Financial Refusal Steering Distillation (FiRSD), an unsupervised training framework that strengthens financial-domain safety by learning and distilling a financial refusal direction at the representation level. FiRSD enhances refusal behavior without requiring annotated refusal responses. Experiments show that FiRSD substantially improves safety while largely preserving task capability. These results highlight the importance of domain-aware safety alignment for high-stakes financial applications.
2025
Don’t Miss the Forest for the Trees: Attentional Vision Calibration for Large Vision Language Models
Sangmin Woo | Donguk Kim | Jaehyuk Jang | Yubin Choi | Changick Kim
Findings of the Association for Computational Linguistics: ACL 2025
Sangmin Woo | Donguk Kim | Jaehyuk Jang | Yubin Choi | Changick Kim
Findings of the Association for Computational Linguistics: ACL 2025
Large Vision Language Models (LVLMs) demonstrate strong capabilities in visual understanding and description, yet often suffer from hallucinations, attributing incorrect or misleading features to images. We observe that LVLMs disproportionately focus on a small subset of image tokens—termed blind tokens—which are typically irrelevant to the query (e.g., background or non-object regions). We hypothesize that such attention misalignment plays a key role in generating hallucinated responses. To mitigate this issue, we propose Attentional Vision Calibration (AvisC), a test-time approach that dynamically recalibrates the influence of blind tokens without modifying the underlying attention mechanism. AvisC first identifies blind tokens by analyzing layer-wise attention distributions over image tokens, then employs a contrastive decoding strategy to balance the influence of original and blind-token-biased logits. Experiments on standard benchmarks, including POPE, MME, and AMBER, demonstrate that AvisC effectively reduces hallucinations in LVLMs.
2024
Detecting Offensive Language in an Open Chatbot Platform
Hyeonho Song | Jisu Hong | Chani Jung | Hyojin Chin | Mingi Shin | Yubin Choi | Junghoi Choi | Meeyoung Cha
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Hyeonho Song | Jisu Hong | Chani Jung | Hyojin Chin | Mingi Shin | Yubin Choi | Junghoi Choi | Meeyoung Cha
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
While detecting offensive language in online spaces remains an important societal issue, there is still a significant gap in existing research and practial datasets specific to chatbots. Furthermore, many of the current efforts by service providers to automatically filter offensive language are vulnerable to users’ deliberate text manipulation tactics, such as misspelling words. In this study, we analyze offensive language patterns in real logs of 6,254,261 chat utterance pairs from the commercial chat service Simsimi, which cover a variety of conversation topics. Based on the observed patterns, we introduce a novel offensive language detection method—a contrastive learning model that embeds chat content with a random masking strategy. We show that this model outperforms existing models in detecting offensive language in open-domain chat conversations while also demonstrating robustness against users’ deliberate text manipulation tactics when using offensive language. We release our curated chatbot dataset to foster research on offensive language detection in open-domain conversations and share lessons learned from mitigating offensive language on a live platform.
Search
Fix author
Co-authors
- Changick Kim 2
- Tsedeniya Solomon Amare 1
- Longju Bai 1
- Bontu Fufa Balcha 1
- Zayd Bashir 1
- Angana Borah 1
- Zara Burzo 1
- Meeyoung Cha 1
- Hyojin Chin 1
- Seungju Cho 1
- Junghoi Choi 1
- Naihao Deng 1
- Michel Faloughi 1
- Samika Gupta 1
- Seokil Ham 1
- Jisu Hong 1
- Jaehyuk Jang 1
- Chani Jung 1
- Donguk Kim 1
- Subin Kim 1
- Youngjun Kwak 1
- Claude Kwizera 1
- Ziqiao Ma 1
- Rada Mihalcea 1
- Joan Nwatu 1
- Cynthia Yacel Fuertes Panizo 1
- Ellie Seehorn 1
- Hui Shen 1
- Mingi Shin 1
- Jungmin Son 1
- Hyeonho Song 1
- Jiayi Tang 1
- Sangmin Woo 1
- Yujin Yang 1
- Zesen Zhao 1
- Boyuan Zheng 1