Shuai Zhao
Author directoryOther people with similar names: Shuai Zhao, Shuai Zhao
Unverified author pages with similar names: Shuai Zhao
2026
ViCo: Towards Visual-oriented Coding with Self-Reflection for Chart Replication
Jiaxin Duan | Dian Jiao | Shuai Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiaxin Duan | Dian Jiao | Shuai Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
This paper addresses the challenge of generating high-quality academic charts that match the visual standards of human-authored papers. While existing AI agents can produce well-structured text and code, their generated visualizations often lack the stylistic and semantic fidelity of human designs. Advanced coding agents that employ self-reflection mechanisms exhibit poor visual reasoning and limited reflection following, resulting in sparse reward signals that severely undermine their reinforcement learning (RL). We propose ViCo, a training framework for visual-oriented coding that employs iterative reflections to align generated chart images progressively with the reference. We first introduce a self-supervised warm-up stage, which augments Monte Carlo Tree Search with consistency-based pruning to synthesize high-quality reflection trajectories, ensuring that each coding step strictly follows the outcomes of prior reflections. A multi-step RL algorithm is then developed on counterfactual baselines to estimate advantage for reflection and action steps within each refinement cycle, thereby addressing the reward sparsity problem. To enable efficient reward in massive training, we propose an automatic, multifaceted evaluation framework that assesses charts’ style, layout, and semantic consistency via a hierarchical heterogeneous layout graph structure. Experiments on three public benchmarks demonstrate that ViCo, trained on an 8B model, achieves performance close to commercial LLMs with adequate reflection capabilities.
Improving Parameter Utilization by Sharing Neural Experts Across Layers in Transformers
Dian Jiao | Jiaxin Duan | Shuai Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Dian Jiao | Jiaxin Duan | Shuai Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Transformer-based large language models often suffer from inter-layer parameter redundancy, where functional transformations are redundantly learned across network depths. We propose CS-MoE, a novel Transformer architecture featuring cross-layer expert sharing to address this inefficiency. Deviating from the widely used Mixture-of-Experts (MoE) architecture that terminates each Transformer block with layer-isolated experts, CS-MoE combines layer-independent experts with concurrent access to a centralized, globally shared expert pool. This Global Experts Sharing mechanism enables elastic control over token-level parameter activation and computational consumption (FLOPs). Experiments demonstrate that CS-MoE achieves lower perplexity than equal-scale dense Transformers while activating only 55% of parameters. Furthermore, its performance scales monotonically with an increased number of activated experts and approaches MoE counterparts that consume more FLOPs by expanding the shared pool without increasing FLOPs. CS-MoE also establishes a flexible Pareto frontier between computational cost and model capacity, offering an efficient alternative for computation-constrained environments.