Zhehan Kan
Author directory2026
When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
Yubo Zhu | Zhehan Kan | Jingyi Yang | Miaolin Chen | Jinbo Xing | Kai Zhu | Zijian Wang | Sheng Zhong | Wei Tong
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yubo Zhu | Zhehan Kan | Jingyi Yang | Miaolin Chen | Jinbo Xing | Kai Zhu | Zijian Wang | Sheng Zhong | Wei Tong
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Unified multimodal models (UMMs) can perform both understanding and generation, raising a central question: can visual generation improve understanding? Existing evaluations provide mixed evidence, but confound task difficulty, reasoning paradigms, and the closed-loop interaction between generation and understanding. We introduce a fine-grained evaluation framework for vision generation-assisted understanding. It stratifies samples by difficulty, enables unified evaluation of multiple reasoning paradigms, and uses Oracle-Assisted Reference Protocols to decouple generation from understanding. Our analysis shows that generated visual aids help on easier instances but become unreliable as reasoning complexity increases. Oracle-assisted diagnosis further reveals that the main bottleneck often lies in visual understanding rather than generation, as current UMMs struggle to leverage even faithful visual aids. We also show that effective visual generation should target visual-understanding bottlenecks rather than add more reasoning steps, and identify a three-stage transition from task-irrelevant noise, to misleading plausible guidance, and finally to useful assistance. These findings lay a reliable foundation for the next stage of UMM development. The code is available at https://github.com/zyb1029/VGAU-Diag.