Youwon Jang
Author directory2026
CS-CLIP: Compositional Scene Graph-guided CLIP for Robust Compositional Reasoning
SeongJun Jeong | Minjoon Jung | Woo Suk Choi | Youwon Jang | Byoung-Tak Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
SeongJun Jeong | Minjoon Jung | Woo Suk Choi | Youwon Jang | Byoung-Tak Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Vision-language models (VLMs) demonstrate strong performance across compositional reasoning benchmarks, which require reasoning over semantic perturbations of objects, attributes, relations, and their interactions. However, our controlled analysis reveals that existing compositionality-aware VLMs exhibit element-specific biases, often underperforming vanilla CLIP on certain compositional elements. To address this, we propose Compositional Scene Graph-guided CLIP (CS-CLIP), which uses scene graphs to identify compositional elements and construct structured negatives via selective masking. We further retain negatives that are most contradictory to the original caption, forcing the model to rely on compositional structure rather than surface cues. CS-CLIP achieves state-of-the-art compositional reasoning with robust performance across compositional elements. It also preserves general vision-language capabilities such as cross-modal retrieval and downstream visual reasoning, while requiring fewer training samples than prior methods.
2025
Confidence-guided Refinement Reasoning for Zero-shot Question Answering
Youwon Jang | Woo Suk Choi | Minjoon Jung | Minsu Lee | Byoung-Tak Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Youwon Jang | Woo Suk Choi | Minjoon Jung | Minsu Lee | Byoung-Tak Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
We propose Confidence-guided Refinement Reasoning (C2R), a novel training-free framework applicable to question-answering (QA) tasks across text, image, and video domains. C2R strategically constructs and refines sub-questions and their answers (sub-QAs), deriving a better confidence score for the target answer. C2R first curates a subset of sub-QAs to explore diverse reasoning paths, then compares the confidence scores of the resulting answer candidates to select the most reliable final answer. Since C2R relies solely on confidence scores derived from the model itself, it can be seamlessly integrated with various existing QA models, demonstrating consistent performance improvements across diverse models and benchmarks. Furthermore, we provide essential yet underexplored insights into how leveraging sub-QAs affects model behavior, specifically analyzing the impact of both the quantity and quality of sub-QAs on achieving robust and reliable reasoning.