Hyunyoung Lee
Author directory2026
SAGE: Semantic Attribute Graphs for Multi-Entity Visual Retrieval
Yongjoo Kim | Mincheol Kwon | Seonga Choi | Minseung Lee | Kyeong-Jin Oh | Hyunyoung Lee | Yunsu Choi | Jungbeom Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yongjoo Kim | Mincheol Kwon | Seonga Choi | Minseung Lee | Kyeong-Jin Oh | Hyunyoung Lee | Yunsu Choi | Jungbeom Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Dense document images often contain many fine-grained visual and textual entities whose relevance depends on a user query. Standard vision-language retrievers encode cropped regions with a single vector, which can mix distinct entity signals and obscure the evidence needed for fine-grained retrieval. We call this failure mode **Semantic Dilution** and quantitatively show that it degrades entity-level retrieval as a function of entity density. To mitigate it, we propose **SAGE**, a training-free framework that parses semantic entities from dense document images, represents them as hierarchical graph nodes with multi-vector embeddings, and retrieves query-relevant evidence through iterative entity-level subgraph matching. We also introduce **DEAR**, a dataset of 1,055 query–image pairs sourced from product detail pages, where each query requires retrieving and comparing multiple fine-grained entities from visually dense inputs across four question types of increasing complexity. Experiments show that SAGE substantially reduces semantic dilution and outperforms patch-level and OCR-based retrieval baselines on DEAR, achieving a Recall@3 of 0.849 and a generation score of 2.746 on multi-entity visual comparison queries. Our code is available at https://github.com/All4Nothing/SAGE.
2025
Watermarking for Factuality: Guiding Vision-Language Models Toward Truth via Tri-layer Contrastive Decoding
Kyungryul Back | Seongbeom Park | Milim Kim | Mincheol Kwon | SangHyeok Lee | Hyunyoung Lee | Junhee Cho | Seunghyun Park | Jinkyu Kim
Findings of the Association for Computational Linguistics: EMNLP 2025
Kyungryul Back | Seongbeom Park | Milim Kim | Mincheol Kwon | SangHyeok Lee | Hyunyoung Lee | Junhee Cho | Seunghyun Park | Jinkyu Kim
Findings of the Association for Computational Linguistics: EMNLP 2025
Large Vision-Language Models (LVLMs) have recently shown promising results on various multimodal tasks, even achieving human-comparable performance in certain cases. Nevertheless, LVLMs remain prone to hallucinations–they often rely heavily on a single modality or memorize training data without properly grounding their outputs. To address this, we propose a training-free, tri-layer contrastive decoding with watermarking, which proceeds in three steps: (1) select a mature layer and an amateur layer among the decoding layers, (2) identify a pivot layer using a watermark-related question to assess whether the layer is visually well-grounded, and (3) apply tri-layer contrastive decoding to generate the final output. Experiments on public benchmarks such as POPE, MME and AMBER demonstrate that our method achieves state-of-the-art performance in reducing hallucinations in LVLMs and generates more visually grounded responses.