Ran Tao
Author directory2026
Towards Effective Experiential Learning: Dual Guidance for Utilization and Internalization
Fei Bai | Zhipeng Chen | Chuan Hao | Ming Yang | Ran Tao | Bryan Dai | Xin Zhao | Jian Yang | Hongteng Xu
Findings of the Association for Computational Linguistics: EMNLP 2026
Fei Bai | Zhipeng Chen | Chuan Hao | Ming Yang | Ran Tao | Bryan Dai | Xin Zhao | Jian Yang | Hongteng Xu
Findings of the Association for Computational Linguistics: EMNLP 2026
Reinforcement learning from verifiable rewards (RLVR) has become a promising paradigm for improving the reasoning capabilities of large language models (LLMs). However, existing RL-based training remains only a rough approximation to human learning, where humans leverage external experience to guide exploration and gradually internalize problem-solving strategies into stable knowledge. Motivated by this gap, we ask: how can LLMs better utilize and internalize experience during RLVR training? To answer this question, we propose Dual Guidance Optimization (DGO), which treats experience as a bridge between external guidance and internal policy learning. Rather than using experience only as an inference-time aid or trajectories only as optimization signals, DGO couples them in a closed loop: experience guides exploration, improved trajectories renew the experience bank, and guided trajectories are rewritten as self-contained traces for policy distillation. This enables the model to better utilize external experience while yielding consistent gains under experience-free inference. Experiments across multiple benchmarks show that DGO consistently outperforms baselines under both experience-free and experience-guided inference, suggesting that coupling utilization and internalization leads to effective reasoning.
LoopCoder: Scaling Code Intelligence via Looped Language Models
Jian Yang | Wei Zhang | Shuyue Guo | Yizhi LI | Linzheng Chai | Zhengmao Ye | Shukai Liu | Yuyang Song | Jiajun Wu | Che Liu | Tianyu Zheng | Siwei Wu | Leo L | Xudong Ma | Chuan Hao | Ran Tao | Yan Xing | Jianzhou Wang | Mingjie Tang | Aishan Liu | Zhoujun Li | Xianglong Liu | Weifeng Lv | Bryan Dai
Findings of the Association for Computational Linguistics: ACL 2026
Jian Yang | Wei Zhang | Shuyue Guo | Yizhi LI | Linzheng Chai | Zhengmao Ye | Shukai Liu | Yuyang Song | Jiajun Wu | Che Liu | Tianyu Zheng | Siwei Wu | Leo L | Xudong Ma | Chuan Hao | Ran Tao | Yan Xing | Jianzhou Wang | Mingjie Tang | Aishan Liu | Zhoujun Li | Xianglong Liu | Weifeng Lv | Bryan Dai
Findings of the Association for Computational Linguistics: ACL 2026
While large language models (LLMs) have mastered syntax-level code generation, complex algorithmic reasoning remains a challenge, typically addressed by scaling model depth and parameter count. Universal Transformers (UT) offer a compelling alternative by introducing a recurrent inductive bias that aligns with the recursive nature of programming logic. However, training looped architectures at scale has historically been hindered by severe instability and optimization difficulties associated with backpropagation through time (BPTT). We present LoopCoder (40B-A80B) pre-trained on 12T+ code and general tokens, along with LoopCoder-Thinking and LoopCoder-Instruct variants—the first large-scale looped transformer for code, achieving comparable performance to standard dense architectures with more parameters. Unlike prior approaches that restrict recurrence to small-scale tasks, we implement a comprehensive looped training protocol spanning both pre-training and post-training phases. We initiate the model via dense-to-loop transformation, folding a pre-trained dense checkpoint to initialize a recurrent block, followed by rigorous looped pre-training and specialized post-training for instruction following and reasoning. Our results establish a robust recipe for scaling coding intelligence via recurrent computation, proving that dense checkpoints serve as an optimal foundation for evolving into dynamic, looped reasoners.
SEAR: Self-Judging Agentic Reward Models
Bingqian Li | Chuan Hao | Junyi Li | Ran Tao | Jian Yang | Xin Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Bingqian Li | Chuan Hao | Junyi Li | Ran Tao | Jian Yang | Xin Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Agentic reward models enhance large language model (LLM) evaluation by incorporating external tool-use capabilities. However, their training is heavily constrained by coarse-grained outcome supervision and the high cost of process-level annotations. To address these challenges, we propose SEAR (Self-judging agentic reward models), a novel training framework that enables agentic reward models to self-judge their own judging processes. SEAR introduces a dual-role adversarial co-evolution framework, where the model alternates between a judger and a self-judger within a single generation process: the judger is optimized to produce more rigorous reasoning trajectories that maximize self-judgment scores, while the self-judger learns to provide critical and discriminative evaluations. Moreover, SEAR further enables agentic RMs to self-evolve without relying on external human annotations. Extensive experiments demonstrate that SEAR consistently improves the reliability of agentic reward models across diverse benchmarks.
InCoder-32B-Thinking: Industrial Code World Model for Thinking
Jian Yang | Wei Zhang | Jiajun Wu | Junhang Cheng | Tuney Zheng | Fanglin Xu | William Grant | Linzheng Chai | Yaxin Du | Haau-Sing Li | Yizhi LI | Yan Xing | Chuan Hao | Ran Tao | Ruihao Gong | Aishan Liu | Zhoujun Li | Mingjie Tang | Chenghua Lin | Siheng Chen | Xin Zhao | Xianglong Liu | Ming Zhou | Bryan Dai | Weifeng Lv
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jian Yang | Wei Zhang | Jiajun Wu | Junhang Cheng | Tuney Zheng | Fanglin Xu | William Grant | Linzheng Chai | Yaxin Du | Haau-Sing Li | Yizhi LI | Yan Xing | Chuan Hao | Ran Tao | Ruihao Gong | Aishan Liu | Zhoujun Li | Mingjie Tang | Chenghua Lin | Siheng Chen | Xin Zhao | Xianglong Liu | Ming Zhou | Bryan Dai | Weifeng Lv
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Industrial code tasks, including chip design, GPU optimization, and firmware, often fail for reasons that are invisible in ordinary source code: timing constraints, backend logs, layout data, simulator behavior, and hardware-specific performance trade-offs. Current code models see many programs but few expert correction traces from these settings. We present InCoder-32B-Thinking, a 32B thinking code model trained with Error-driven Chain-of-Thought (ECoT) synthesis and an Industrial Code World Model (ICWM). ECoT converts several rounds of toolchain signals into reasoning traces by preserving the failed code, the observed failure, and the later fix. ICWM learns from execution traces in domains such as Verilog simulation and GPU profiling, then predicts feedback for the data engine, which can build more repair traces without routing every candidate through a real toolchain. The data keeps the uneven reasoning depth of industrial work: short traces for simple cases, long traces for hardware-level debugging. Across 23 tests (14 general and 9 industrial), InCoder-32B-Thinking reaches 81.3% on LiveCodeBench v5, 84.0% CAD-Coder compile success, and 38.0% on KernelBench L2, while remaining competitive on general coding tasks. Model weights and code are available at Hugging Face: https://huggingface.co/Multilingual-Multimodal-NLP/IndustrialCoder and GitHub: https://github.com/CSJianYang/Industrial-Coder.
Polymorphic Universal Transformer
Yilong Chen | Zitian Gao | Yihao Xiao | Jason Klein Liu | Xinyu Yang | Yifan Luo | Haoming Luo | Zhengmao Ye | Tingwen Liu | Ran Tao | Bryan Dai
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yilong Chen | Zitian Gao | Yihao Xiao | Jason Klein Liu | Xinyu Yang | Yifan Luo | Haoming Luo | Zhengmao Ye | Tingwen Liu | Ran Tao | Bryan Dai
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Although the Universal Transformer (UT) mitigates the diminishing returns of standard LLM scaling by decoupling parameter count from depth, it remains constrained by linear computational costs and rigid weight-sharing mechanisms. These limitations lead to severe functional homogeneity, which subsequently induces over-smoothing, representation rank collapse, and degraded reasoning performance. In this work, we present the first systematic study of Compute Distribution Skew, identifying it as the primary driver of extrapolation failure. This is a pathological phenomenon in ultra-deep recurrent Transformers characterized by a disproportionate distribution of contributions across recurrent steps, resulting in distinct functional states during prefix and suffix processing phases. To address this challenge, we propose the Polymorphic Transformer, which aims to achieve functional polymorphism and depth sparsity within a shared-parameter framework. By integrating conditional sparse subspaces, SiLU Attention, and an uncertainty-aware depth scheduler, our architecture mitigates power-method collapse and effectively decouples logical depth from computational cost. Experiments demonstrate that our model significantly enhances representation rank and robustness, achieving complex reasoning performance comparable to baseline while reducing computation by 64.7%.
2025
Speech-Like Cues and the Limits of Musicality: Lexical Tone Normalization in Mandarin across Speech, Rap, and Song Contexts
Yujia Tian | Yanyuan Ye | Mingxi Lu | Fanlu Jia | Ran Tao
Proceedings of the 39th Pacific Asia Conference on Language, Information and Computation
Yujia Tian | Yanyuan Ye | Mingxi Lu | Fanlu Jia | Ran Tao
Proceedings of the 39th Pacific Asia Conference on Language, Information and Computation
Effect of Emotional Congruency and Cognitive Load on Word Processing
Jieyu Chen | Yujia Tian | Jing Qi | Ran Tao
Proceedings of the 39th Pacific Asia Conference on Language, Information and Computation
Jieyu Chen | Yujia Tian | Jing Qi | Ran Tao
Proceedings of the 39th Pacific Asia Conference on Language, Information and Computation
2024
Effect of Rap Music Context on Lexical Tone Normalization
Yujia Tian | Yanyuan Ye | Mingxi Lu | Fanlu Jia | Ran Tao
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Yujia Tian | Yanyuan Ye | Mingxi Lu | Fanlu Jia | Ran Tao
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
The Influence of Language on Personality Traits: A Multi-modal Study Among Chinese-English Bilinguals
Mingxi Lu | Ran Tao
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Mingxi Lu | Ran Tao
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Mandarin speakers prefer explicit visual cues in learning Cantonese tones: an eye-tracking study
Yuqin Shu | Yi Weng | Ran Tao | Gang Peng
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Yuqin Shu | Yi Weng | Ran Tao | Gang Peng
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
2020
Search
Fix author
Co-authors
- Bryan Dai 4
- Chuan Hao 4
- Jian Yang 4
- Mingxi Lu 3
- Yujia Tian 3
- Wayne Xin Zhao 3
- Linzheng Chai 2
- Fanlu Jia 2
- Yizhi Li 2
- Zhoujun Li 2
- Aishan Liu 2
- Xianglong Liu 2
- Weifeng Lv 2
- Gang Peng 2
- Mingjie Tang 2
- Jiajun Wu 2
- Yan Xing 2
- Yanyuan Ye 2
- Zhengmao Ye 2
- Wei Zhang 2
- Tianyu Zheng 2
- Fei Bai 1
- Jieyu Chen 1
- Siheng Chen 1
- Yilong Chen 1
- Zhipeng Chen 1
- Junhang Cheng 1
- Yaxin Du 1
- Zitian Gao 1
- Ruihao Gong 1
- Weicheng Gu 1
- Shuyue Guo 1
- Leo L 1
- Bingqian Li 1
- Haau-Sing Li 1
- Junyi Li 1
- Chenghua Lin 1
- Che Liu 1
- Jason Klein Liu 1
- Shukai Liu 1
- Tingwen Liu 1
- Haoming Luo 1
- Yifan Luo 1
- Xudong Ma 1
- Jing Qi 1
- Yuqin Shu 1
- Yuyang Song 1
- Jianzhou Wang 1
- Yi Weng 1
- Siwei Wu 1
- Yihao Xiao 1
- Fanglin Xu 1
- Hongteng Xu 1
- Ming Yang 1
- Xinyu Yang 1
- Ming Zhou 1