Team CPS Lab at SHROOM-Visions: Parameter-Efficient Vision-Language Hallucination Detection with Threshold Tuning

Anika Srivastava, Vishal Kumar, Harshita Sharma, Nitisha Aggarwal, Geetika Jain Saxena, Amit Pundir, Sanjeev Singh


Abstract
Fine-grained large-vision-language hallucination detection presents the challenge of locating hallucinated content in image-grounded responses and classifying them with corresponding hallucination categories. Our method for the SHROOM-Visions 2026 Shared Task explores a parameter-efficient solution by fine-tuning a lightweight token-level classification head on the frozen weights of the Qwen3-VL-8B-Instruct vision-language model. We utilized category-specific thresholds calculated based on validation character-level IoU and designed a span merging post-processing step to facilitate span localization with fewer fragmented predictions. We also establish a possible connection between the annotator agreement and the operating thresholds. Our analysis suggests that, within our experimental setup, hallucination categories that had higher inter-annotator agreement tended to have higher optimal decision thresholds whereas categories with lower agreement tended to have lower optimal decision thresholds. Our parameter-efficient method achieved ranks 18th, 16th, 16th, and 15th place on the English, French, Italian, and Chinese tracks, respectively, showing promising performance for multilingual fine-grained hallucination detection.
Anthology ID:
2026.uncertainlp-main.58
Volume:
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Wilker Aziz, Jonathan Berant, Bryan Eikema, Evgenia Ilia, Marie-Catherine de Marneffe, Barbara Plank, Artem Shelmanov, Swabha Swayamdipta, Jörg Tiedemann, Artem Vazhentsev, Raúl Vázquez, Chrysoula Zerva
Venues:
UncertaiNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
828–833
Language:
URL:
https://aclanthology.org/2026.uncertainlp-main.58/
DOI:
Bibkey:
Cite (ACL):
Anika Srivastava, Vishal Kumar, Harshita Sharma, Nitisha Aggarwal, Geetika Jain Saxena, Amit Pundir, and Sanjeev Singh. 2026. Team CPS Lab at SHROOM-Visions: Parameter-Efficient Vision-Language Hallucination Detection with Threshold Tuning. In The Proceedings of the Third Workshop on Uncertainty-Aware NLP, pages 828–833, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Team CPS Lab at SHROOM-Visions: Parameter-Efficient Vision-Language Hallucination Detection with Threshold Tuning (Srivastava et al., UncertaiNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.uncertainlp-main.58.pdf