Pei Yang
Author directory2026
FlowTrain: Flow-Based Decoupled Training for Industrial-Grade Vision-Language Models
Zhida Jiang | Zhaolong Xing | Pei Yang | Xiaolong Chen | Yuanhang Xiao | Chengzhi Huang | Xiyu Liu | Haopeng Liu | Qingyuan Sang | Lingfeng Zhou | Jiaxing Wang | Zicheng Zhang | Wenzhe Wang | Liuxinyu | Yan Li | Zhen Chen | Ke Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Zhida Jiang | Zhaolong Xing | Pei Yang | Xiaolong Chen | Yuanhang Xiao | Chengzhi Huang | Xiyu Liu | Haopeng Liu | Qingyuan Sang | Lingfeng Zhou | Jiaxing Wang | Zicheng Zhang | Wenzhe Wang | Liuxinyu | Yan Li | Zhen Chen | Ke Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Industrial-grade distributed training of vision-language models (VLMs) remains far less efficient than that of unimodal LLMs. Existing solutions either follow a monolithic design that assigns uniform parallelism to heterogeneous modules or adopt a disaggregated deployment that separates modules while executing them as a batch-synchronized pipeline. In this paper, we highlight that the above solutions are still not sufficient, and VLM training can be further decoupled. To this end, we present FlowTrain, a flow-based decoupled training framework that reformulates VLM training as a producer-consumer dataflow coordinated through a unified memory pool. The encoder and backbone can progress independently over a global virtual address space. Since this execution decoupling fundamentally changes the optimization objective of allocation and scheduling, FlowTrain further introduces a heterogeneous parallel allocator that assigns module-specific parallelism strategies by solving a throughput matching problem. The dynamic packing scheduler is used to construct balanced microbatches at runtime according to the actual LLM-side computation cost. Extensive experiments on real-world workloads show that FlowTrain achieves over 50% MFU and up to 1.7× throughput improvement, narrowing the efficiency gap to LLM-only training.
EVM-QuestBench: An Execution-Grounded Benchmark for Natural-Language Transaction Code Generation
Pei Yang | Wanyi Chen | Ke Wang | Lynn Ai | Eric Yang | Tianyu Shi
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Pei Yang | Wanyi Chen | Ke Wang | Lynn Ai | Eric Yang | Tianyu Shi
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models are increasingly applied to various development scenarios. However, in on-chain transaction scenarios, even a minor error can cause irreversible loss for users. Existing evaluations often overlook execution accuracy and safety. We introduce EVM-QuestBench, an execution-grounded benchmark for natural-language transaction-script generation on EVM-compatible chains. The benchmark employs dynamic evaluation: instructions are sampled from template pools, numeric parameters are drawn from predefined intervals, and validators verify outcomes against these instantiated values. EVM-QuestBench contains 107 tasks (62 atomic, 45 composite). Its modular architecture enables rapid task development. The runner executes scripts on a forked EVM chain with snapshot isolation; composite tasks apply step-efficiency decay. We evaluate 20 models with 5 independent rounds each and find large performance gaps, with split scores revealing persistent asymmetry between single-action precision and multi-step workflow completion. Code: https://github.com/OpenEdgeHQ/EVM-quest-bench.