SurgMind-R1: Overcoming Reasoning Collapse in Surgical Vision-Language Models via Reinforcement Learning

Yifan Luo, Guoming Wang, Ling Xiao, Juncheng Li, Siliang Tang


Abstract
Vision-Language Models (VLMs) show immense promise in medicine, yet surgical scene understanding remains formidable due to complex visual obstructions and rigorous multi-step clinical logic. Standard Supervised Fine-Tuning (SFT) imparts domain knowledge, but we identify a critical flaw—the "Reasoning Collapse" phenomenon: during answer-only SFT, models progressively lose explicit step-by-step reasoning capabilities, regressing into "black boxes" that generate uninterpretable shortcut answers—a severe risk for clinical traceability. Constructing high-quality Chain-of-Thought (CoT) datasets to mitigate this is prohibitively expensive in the surgical domain. We propose SurgMind-R1, a surgical VLM with a three-stage training pipeline. We construct Cholec-Think, a reasoning-enhanced dataset combining expert and VLM-assisted CoT annotations; apply domain-adaptive SFT and reasoning-enhanced SFT on Cholec-Think to internalize surgical logic; and introduce Reinforcement Learning via Group Relative Policy Optimization (GRPO) with rule-based rewards to enforce structured thinking paths and eliminate reasoning collapse. On SurgLite-Bench, our comprehensive benchmark, SurgMind-R1 significantly outperforms state-of-the-art VLMs on complex inference tasks. It internalizes structured thinking, maintaining high accuracy in a direct no-think mode that resolves the high-latency bottleneck of reasoning models for real-time clinical applications, and exhibits strong zero-shot out-of-distribution (OOD) generalization across unseen surgical scenarios and novel tasks, paving the way for transparent, trustworthy computer-assisted interventions. The code, benchmark, and models will be available at https://github.com/YifanLuo0103/SurgMind-R1.
Anthology ID:
2026.emnlp-main.739
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17127–17143
Language:
URL:
https://aclanthology.org/2026.emnlp-main.739/
DOI:
Bibkey:
Cite (ACL):
Yifan Luo, Guoming Wang, Ling Xiao, Juncheng Li, and Siliang Tang. 2026. SurgMind-R1: Overcoming Reasoning Collapse in Surgical Vision-Language Models via Reinforcement Learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 17127–17143, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SurgMind-R1: Overcoming Reasoning Collapse in Surgical Vision-Language Models via Reinforcement Learning (Luo et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.739.pdf