Haoyue Yang
Author directoryUnverified author pages with similar names: Haoyue Yang
2026
OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward
Haoyue Yang | Xuanle Zhao | Xuexin Liu | Feibing Jiang | Yao Zhu
Findings of the Association for Computational Linguistics: ACL 2026
Haoyue Yang | Xuanle Zhao | Xuexin Liu | Feibing Jiang | Yao Zhu
Findings of the Association for Computational Linguistics: ACL 2026
The paradigm of programmable diagram generation is evolving rapidly, playing a crucial role in structured visualization. However, most existing studies are confined to a narrow range of task formulations and language support, constraining their applicability to diverse diagram types. In this work, we propose OmniDiagram, a unified framework that incorporates diverse diagram code languages and task definitions. To address the challenge of aligning code logic with visual fidelity in Reinforcement Learning (RL), we introduce a novel visual feedback strategy named Visual Interrogation Verifies All (Viva). Unlike brittle syntax-based rules or pixel-level matching, Viva rewards the visual structure of rendered diagrams through a generative approach. Specifically, Viva actively generates targeted visual inquiries to scrutinize diagram visual fidelity and provides fine-grained feedback for optimization. This mechanism facilitates a self-evolving training process, effectively obviating the need for manually annotated ground truth code. Furthermore, we construct M32Diagram, the first large-scale diagram code generation dataset, containing over 196k high-quality instances. Experimental results confirm that the combination of SFT and our Viva-based RL allows OmniDiagram to establish a new state-of-the-art (SOTA) across diagram code generation benchmarks.
VinciCoder: Unifying Multimodal Code Generation via Coarse-to-fine Visual Reinforcement Learning
Xuanle Zhao | Deyang Jiang | Zhixiong Zeng | Lei Chen | Haoyue Yang | Haibo Qiu | Jing Huang | Yufeng Zhong | Liming Zheng | Yilin Cao | Lin Ma
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xuanle Zhao | Deyang Jiang | Zhixiong Zeng | Lei Chen | Haoyue Yang | Haibo Qiu | Jing Huang | Yufeng Zhong | Liming Zheng | Yilin Cao | Lin Ma
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
While recent specialized multimodal code generation models excel in tasks like chart-to-code generation, their reliance on single-task training limits generalization and hinders the development of VIsioN Code Intelligence. In this work, we introduce VinciCoder, a unified framework designed for generalized multimodal code generation. We first curate a large-scale SFT corpus comprising 1.3M direct generation pairs and 300k visual-based refinement tasks. This composition fosters self-refinement capabilities, enabling the model to directly rectify code to align with input images. Subsequently, we propose coarse-to-fine Visual Reinforcement Learning (ViRL) to overcome the brittleness of textual metrics in handling semantically equivalent but syntactically diverse code. By quantifying visual similarity across multi-scale patches, ViRL provides an implementation-agnostic reward mechanism that ensures high-fidelity alignment between rendered outputs and input visuals. Extensive experimental results across diverse benchmarks demonstrate that VinciCoder achieves superior performance, while comprehensive ablation studies validate the effectiveness of our proposed ViRL strategy. The data, code and model are available at https://github.com/DocTron-hub/VinciCoder.