Jiajun Wu
Author directoryOther people with similar names: Jiajun Wu
Unverified author pages with similar names: Jiajun Wu
2026
LoopCoder: Scaling Code Intelligence via Looped Language Models
Jian Yang | Wei Zhang | Shuyue Guo | Yizhi LI | Linzheng Chai | Zhengmao Ye | Shukai Liu | Yuyang Song | Jiajun Wu | Che Liu | Tianyu Zheng | Siwei Wu | Leo L | Xudong Ma | Chuan Hao | Ran Tao | Yan Xing | Jianzhou Wang | Mingjie Tang | Aishan Liu | Zhoujun Li | Xianglong Liu | Weifeng Lv | Bryan Dai
Findings of the Association for Computational Linguistics: ACL 2026
Jian Yang | Wei Zhang | Shuyue Guo | Yizhi LI | Linzheng Chai | Zhengmao Ye | Shukai Liu | Yuyang Song | Jiajun Wu | Che Liu | Tianyu Zheng | Siwei Wu | Leo L | Xudong Ma | Chuan Hao | Ran Tao | Yan Xing | Jianzhou Wang | Mingjie Tang | Aishan Liu | Zhoujun Li | Xianglong Liu | Weifeng Lv | Bryan Dai
Findings of the Association for Computational Linguistics: ACL 2026
While large language models (LLMs) have mastered syntax-level code generation, complex algorithmic reasoning remains a challenge, typically addressed by scaling model depth and parameter count. Universal Transformers (UT) offer a compelling alternative by introducing a recurrent inductive bias that aligns with the recursive nature of programming logic. However, training looped architectures at scale has historically been hindered by severe instability and optimization difficulties associated with backpropagation through time (BPTT). We present LoopCoder (40B-A80B) pre-trained on 12T+ code and general tokens, along with LoopCoder-Thinking and LoopCoder-Instruct variants—the first large-scale looped transformer for code, achieving comparable performance to standard dense architectures with more parameters. Unlike prior approaches that restrict recurrence to small-scale tasks, we implement a comprehensive looped training protocol spanning both pre-training and post-training phases. We initiate the model via dense-to-loop transformation, folding a pre-trained dense checkpoint to initialize a recurrent block, followed by rigorous looped pre-training and specialized post-training for instruction following and reasoning. Our results establish a robust recipe for scaling coding intelligence via recurrent computation, proving that dense checkpoints serve as an optimal foundation for evolving into dynamic, looped reasoners.
UCoder: Unsupervised Code Generation by Internal Probing of Large Language Models
Jiajun Wu | Jian Yang | Wei Zhang | Linzheng Chai | Yuchi Ma | Ensheng Shi | Yuqing Ma | Zhoujun Li | Xianglong Liu
Findings of the Association for Computational Linguistics: ACL 2026
Jiajun Wu | Jian Yang | Wei Zhang | Linzheng Chai | Yuchi Ma | Ensheng Shi | Yuqing Ma | Zhoujun Li | Xianglong Liu
Findings of the Association for Computational Linguistics: ACL 2026
Large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks. However, their effectiveness heavily relies on supervised training with extensive labeled (e.g., question-answering pairs) or unlabeled datasets (e.g., code snippets), which are often expensive and difficult to obtain at scale. To address this limitation, this paper introduces a method IPC, an unsupervised framework that leverages Internal Probing of LLMs for Code generation without any external corpus, even unlabeled code snippets. We introduce the problem space probing, test understanding probing, solution space probing, and knowledge consolidation and reinforcement to probe the internal knowledge and confidence patterns existing in LLMs. Further, IPC identifies reliable code candidates through self-consistency mechanisms and representation-based quality estimation to train UCoder (coder with unsupervised learning). We validate the proposed approach across multiple code benchmarks, demonstrating that unsupervised methods can achieve competitive performance compared to supervised approaches while significantly reducing the dependency on labeled data and computational resources. Analytic experiments reveal that internal model states contain rich signals about code quality and correctness, and that properly harnessing these signals enables effective unsupervised learning for code generation tasks, opening new directions for training code LLMs in resource-constrained scenarios.
V-GameGym: Visual Game Generation for Code Large Language Models
Wei Zhang | Jian Yang | Renshuai Tao | Linzheng Chai | Shuyue Guo | Jiajun Wu | Xiaoming Chen | Ganqu Cui | Ning Ding | Xander Xu | HU Wei | Bowen Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Wei Zhang | Jian Yang | Renshuai Tao | Linzheng Chai | Shuyue Guo | Jiajun Wu | Xiaoming Chen | Ganqu Cui | Ning Ding | Xander Xu | HU Wei | Bowen Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Code large language models have demonstrated remarkable capabilities in programming tasks, yet current benchmarks primarily focus on single modality rather than visual game development. Most existing code-related benchmarks evaluate syntax correctness and execution accuracy, overlooking critical game-specific metrics such as playability, visual aesthetics, and user engagement that are essential for real-world deployment. To address the gap between current LLM capabilities in algorithmic problem-solving and competitive programming versus the comprehensive requirements of practical game development, we present V-GameGym, a comprehensive benchmark comprising 2,219 high-quality samples across 100 thematic clusters derived from real-world repositories, adopting a novel clustering-based curation methodology to ensure both diversity and structural completeness. Further, we introduce a multimodal evaluation framework with an automated LLM-driven pipeline for visual code synthesis using complete UI sandbox environments. Our extensive analysis reveals that V-GameGym effectively bridges the gap between code generation accuracy and practical game development workflows, providing quantifiable quality metrics for visual programming and interactive element generation.
WebWorld: The Browser as a World Model for Self-Improving Web Code
Jiajun Wu | Jian Yang | Yaxin Du | Wei Zhang | Haowen Wang | Junhang Cheng | Yuxuan Zhang | Tuney Zheng | Xianglong Liu | Ming Zhou
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jiajun Wu | Jian Yang | Yaxin Du | Wei Zhang | Haowen Wang | Junhang Cheng | Yuxuan Zhang | Tuney Zheng | Xianglong Liu | Ming Zhou
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
VLM-driven self-improvement of web code has a structural flaw: the model that proposes the repair is the model that judges it, and visual plausibility under that judge is a poor proxy for whether the page actually works. What the loop is missing is a counterparty the VLM cannot fool, and the browser already is that counterparty: a deterministic, executable simulator of how an HTML artifact behaves under user actions, and in everything but name a world model for web code. We present WEBWORLD, the interface that lets a VLM prior interact with this browser-as-world-model autonomously and decides which interactions become supervision. Each round, the VLM emits a critique that the planner compiles into a typed interaction contract; the browser re-executes the candidate and issues an acceptance certificate only when both target progress and preservation of every previously verified capability hold; certified transitions accumulate as a quality ratchet that is the only thing the SFT export ever sees. Under matched training, WEBWORLD-27B improves Raw-27B by 5.3 points on HTMLBench-400 and 14.9 points on MiniAppBench-Val, and reaches the level of strong frontier systems such as Kimi-K2.6 and GPT-5.4 on interactive HTML generation. Equal-size ablations show that browser-backed admission carries the gain: without the certificate, the matched 9B lift nearly disappears.
InCoder-32B-Thinking: Industrial Code World Model for Thinking
Jian Yang | Wei Zhang | Jiajun Wu | Junhang Cheng | Tuney Zheng | Fanglin Xu | William Grant | Linzheng Chai | Yaxin Du | Haau-Sing Li | Yizhi LI | Yan Xing | Chuan Hao | Ran Tao | Ruihao Gong | Aishan Liu | Zhoujun Li | Mingjie Tang | Chenghua Lin | Siheng Chen | Xin Zhao | Xianglong Liu | Ming Zhou | Bryan Dai | Weifeng Lv
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jian Yang | Wei Zhang | Jiajun Wu | Junhang Cheng | Tuney Zheng | Fanglin Xu | William Grant | Linzheng Chai | Yaxin Du | Haau-Sing Li | Yizhi LI | Yan Xing | Chuan Hao | Ran Tao | Ruihao Gong | Aishan Liu | Zhoujun Li | Mingjie Tang | Chenghua Lin | Siheng Chen | Xin Zhao | Xianglong Liu | Ming Zhou | Bryan Dai | Weifeng Lv
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Industrial code tasks, including chip design, GPU optimization, and firmware, often fail for reasons that are invisible in ordinary source code: timing constraints, backend logs, layout data, simulator behavior, and hardware-specific performance trade-offs. Current code models see many programs but few expert correction traces from these settings. We present InCoder-32B-Thinking, a 32B thinking code model trained with Error-driven Chain-of-Thought (ECoT) synthesis and an Industrial Code World Model (ICWM). ECoT converts several rounds of toolchain signals into reasoning traces by preserving the failed code, the observed failure, and the later fix. ICWM learns from execution traces in domains such as Verilog simulation and GPU profiling, then predicts feedback for the data engine, which can build more repair traces without routing every candidate through a real toolchain. The data keeps the uneven reasoning depth of industrial work: short traces for simple cases, long traces for hardware-level debugging. Across 23 tests (14 general and 9 industrial), InCoder-32B-Thinking reaches 81.3% on LiveCodeBench v5, 84.0% CAD-Coder compile success, and 38.0% on KernelBench L2, while remaining competitive on general coding tasks. Model weights and code are available at Hugging Face: https://huggingface.co/Multilingual-Multimodal-NLP/IndustrialCoder and GitHub: https://github.com/CSJianYang/Industrial-Coder.
Search
Fix author
Co-authors
- Jian Yang 5
- Wei Zhang 5
- Linzheng Chai 4
- Zhoujun Li 3
- Xianglong Liu 3
- Tianyu Zheng 3
- Junhang Cheng 2
- Bryan Dai 2
- Yaxin Du 2
- Shuyue Guo 2
- Chuan Hao 2
- Yizhi Li 2
- Aishan Liu 2
- Weifeng Lv 2
- Mingjie Tang 2
- Ran Tao 2
- Yan Xing 2
- Ming Zhou 2
- Siheng Chen 1
- Xiaoming Chen 1
- Ganqu Cui 1
- Ning Ding 1
- Ruihao Gong 1
- Weicheng Gu 1
- Leo L 1
- Haau-Sing Li 1
- Chenghua Lin 1
- Che Liu 1
- Shukai Liu 1
- Xianglong Liu 1
- Xudong Ma 1
- Yuchi Ma 1
- Yuqing Ma 1
- Ensheng Shi 1
- Yuyang Song 1
- Renshuai Tao 1
- Haowen Wang 1
- Jianzhou Wang 1
- HU Wei 1
- Siwei Wu 1
- Fanglin Xu 1
- Xander Xu 1
- Zhengmao Ye 1
- Yuxuan Zhang 1
- Wayne Xin Zhao 1
- Bowen Zhou 1