Fei Zhao
Author directoryAlso published as: Fei zhao
Other people with similar names: Fei Zhao
Unverified author pages with similar names: Fei Zhao
2026
Rethinking Diffusion Large Language Models via Time-aware Weighting and Block-oriented Refinements
Zheyong Xie | Shengrui Li | Li Zhong | Kaiyan Zhao | Fangcheng Shi | Jiakang Wang | Huayi Jin | Zhaokai Luo | Fei Zhao | Haifeng Liu | Jieying Ye | Chonggang Lu | Wenxuan Huang | Yue Liu | Zijie Meng | Shaosheng Cao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zheyong Xie | Shengrui Li | Li Zhong | Kaiyan Zhao | Fangcheng Shi | Jiakang Wang | Huayi Jin | Zhaokai Luo | Fei Zhao | Haifeng Liu | Jieying Ye | Chonggang Lu | Wenxuan Huang | Yue Liu | Zijie Meng | Shaosheng Cao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Diffusion Large Language Models (DLLMs) have recently emerged as a parallel alternative to autoregressive models, offering bidirectional context modeling and parallel decoding. However, developing highly performant DLLMs is hindered by lifecycle challenges, including suboptimal timestep weighting in pre-training, train-inference distribution gaps in post-training, and underutilized caching during inference. To address these obstacles, we introduce ReDLLM, a 30B-parameter Mixture-of-Experts DLLM. It incorporates a time-aware weighting strategy during continual pre-training that scales gradients according to denoising difficulty. Furthermore, we propose two block-oriented refinements: a terminal-block treatment to narrow the train-inference gap, and a block-aware inference pipeline featuring inline block prefill and block-level scheduling to maximize KV-cache reuse and parallelization. Extensive evaluations demonstrate that ReDLLM surpasses existing DLLMs at the same active-parameter scale, achieves generation quality competitive with 100B DLLMs, and attains the highest inference throughput among evaluated models.
Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors
Zhiwei Zhang | Fei Zhao | Rui Wang | Zezhong Wang | Bin Liang | Jiakang Wang | Yao Hu | Shaosheng Cao | Kam-Fai Wong
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhiwei Zhang | Fei Zhao | Rui Wang | Zezhong Wang | Bin Liang | Jiakang Wang | Yao Hu | Shaosheng Cao | Kam-Fai Wong
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models (LLMs) can call tools effectively, yet they remain brittle in multi-turn execution: after a tool-call error, smaller models often fall into repetitive invalid re-invocations instead of interpreting the feedback and recovering. This failure mode persists because current training paradigms do not explicitly teach models how to recover from execution errors. In particular, standard reinforcement learning (RL) collapses rich failure experience into sparse negative rewards, while pre-collected error-correction datasets become mismatched to the policy’s evolving failure modes. To bridge this gap, we propose Fission-GRPO, a framework that converts execution errors into on-policy corrective supervision within the RL training loop. Our core mechanism fissions each failed trajectory into a new training instance by augmenting it with diagnostic feedback from a fine-tuned Error Simulator, then resampling multiple recovery rollouts on-policy. This enables the model to learn from the precise errors it makes during exploration, rather than from static, pre-collected error cases. On BFCL v4 Multi-Turn, Fission-GRPO improves the error recovery rate of Qwen3-8B by 5.7% absolute and overall accuracy by 4.0% (from 42.75% to 46.75%), outperforming both RL baselines and specialized tool-use agents. The method further generalizes to TAU-Bench and TAU2-Bench, achieving leading results across most settings with gains up to +17.4%.
RedOne 2.0: Rethinking Domain-specific LLM Post-Training in Social Networking Services
Fei zhao | Chonggang Lu | Haofu Qian | Fangcheng Shi | Zijie Meng | Jianzhao Huang | Zheyong Xie | Shaosheng Cao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Fei zhao | Chonggang Lu | Haofu Qian | Fangcheng Shi | Zijie Meng | Jianzhao Huang | Zheyong Xie | Shaosheng Cao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
As a primary medium for human interaction and information exchange, social networking services (SNS) present distinct challenges for large language models (LLMs): rapidly evolving norms and slang, and culturally diverse content that causes knowledge distribution shift. While supervised fine-tuning (SFT) can improve in-domain performance, it often induces a ”seesaw” trade-off with out-of-domain robustness, especially for smaller models. To address these challenges, we present RedOne 2.0, an SNS-oriented LLM developed with a progressive, RL-prioritized post-training paradigm for fast and stable adaptation. Our pipeline has three stages: (1) Exploratory Learning on curated SNS corpora to establish initial alignment and surface systematic weaknesses; (2) Targeted Fine-Tuning that applies SFT only to diagnosed gaps while mixing a small amount of general data to reduce forgetting; and (3) Refinement Learning that re-applies RL with SNS-centric signals to consolidate gains and balance trade-offs across tasks. Across various tasks in three categories, our 4B model improves by 2.41 on average over the prior 7B RedOne baseline. It also yields an 8.74 average gain over its Qwen3-4B base while using less than half the data required by the SFT-centric method, demonstrating superior data efficiency and stability at compact scales. Overall, RedOne 2.0 provides a competitive, cost-effective baseline for SNS-specific LLMs, improving capability without sacrificing robustness.
2025
RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services
Fei Zhao | Chonggang Lu | Wangyue | Zheyong Xie | Ziyan Liu | Haofu Qian | Jianzhao Huang | Fangcheng Shi | Zijie Meng | Hongcheng Guo | Mingqian He | Xinze Lyu | Zheyu Ye | Weiting Liu | Boyang Wang | Shaosheng Cao
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
Fei Zhao | Chonggang Lu | Wangyue | Zheyong Xie | Ziyan Liu | Haofu Qian | Jianzhao Huang | Fangcheng Shi | Zijie Meng | Hongcheng Guo | Mingqian He | Xinze Lyu | Zheyu Ye | Weiting Liu | Boyang Wang | Shaosheng Cao
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
As a primary medium for modern information dissemination, social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement. Recently, the development of large language models (LLMs) has offered potential solutions but existing studies focus on isolated tasks, which not only encounter diminishing benefit from the data scaling within individual scenarios but also fail to flexibly adapt to diverse real-world context. To address these challenges, we introduce RedOne, a domain-specific LLM designed to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for the SNS. RedOne was developed through a three-stage training strategy consisting of continue pretraining, supervised fine-tuning, and preference optimization, using a large-scale real-world dataset. Through extensive experiments, RedOne maintains strong general capabilities, and achieves an average improvement up to 14.02% across 8 major SNS tasks and 7.56% in SNS bilingual evaluation benchmark, compared with base models. Furthermore, through online testing, RedOne reduced the exposure rate in harmful content detection by 11.23% and improved the click page rate in post-view search by 14.95% compared with single-tasks baseline models. These results establish RedOne as a robust domain-specific LLM for SNS, demonstrating excellent generalization across various tasks and promising applicability in real-world scenarios.
Search
Fix author
Co-authors
- Shaosheng Cao 4
- Chonggang Lu 3
- Zijie Meng 3
- Fangcheng Shi 3
- Zheyong Xie 3
- Jianzhao Huang 2
- Haofu Qian 2
- Jiakang Wang 2
- Hongcheng Guo 1
- Mingqian He 1
- Yao Hu 1
- Wenxuan Huang 1
- Huayi Jin 1
- Shengrui Li 1
- Bin Liang 1
- Haifeng Liu 1
- Weiting Liu 1
- Yue Liu 1
- Ziyan Liu 1
- Zhaokai Luo 1
- Xinze Lyu 1
- Boyang Wang 1
- Rui Wang 1
- Zezhong Wang 1
- Wangyue 1
- Kam-Fai Wong 1
- Jieying Ye 1
- Zheyu Ye 1
- Zhiwei Zhang 1
- Kaiyan Zhao 1
- Li Zhong 1