Junyoung Jeon
Author directory2026
Team hccl-jy at SHROOM-Visions: Confidence Signals from an Unmodified VLM Verifier
Junyoung Jeon | Bongwon Suh
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Junyoung Jeon | Bongwon Suh
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Vision-language models (VLMs) can describe details an image does not support. Detecting such hallucinations requires locating the unsupported text rather than flagging whole responses. The SHROOM-Visions shared task asks systems to localize these spans, classify their error type, and assign character-level probabilities. This paper describes the hccl-jy English-track submission. We ask whether confidence from a pretrained VLM verifier can support this task without fine-tuning, and whether candidate-level gains survive extraction and aggregation. The system runs an unmodified Qwen2.5-VL verifier over spaCy candidates with exact character offsets. An aggregation model fitted on held-out calibration data converts candidate judgments into output spans. We compare verbalized confidence, verdict-token probability, and five-draw consistency against annotator agreement, calibration error, and the official metrics. Verdict-token probability separates high-agreement candidates from low-agreement ones more reliably at 32B than at 7B. Averaging repeated judgments improves this ranking further but does not improve the official score. Error analysis shows that the initial score comes mostly from correct empty predictions and that error typing is weak for invented content. Revising only the aggregation over cached judgments raises Cor on development and test data. The findings support evaluating confidence discrimination, calibration, and end-to-end performance as separate targets.