Wenhao Zeng
Author directory2026
Pruning the Unsurprising: Efficient LLM Reasoning via First-Token Surprisal
Wenhao Zeng | Chao Hu | Yaoning Wang | Yuling Shi | Chengcheng Wan | Hongyu Zhang | Xiaodong Gu
Findings of the Association for Computational Linguistics: EMNLP 2026
Wenhao Zeng | Chao Hu | Yaoning Wang | Yuling Shi | Chengcheng Wan | Hongyu Zhang | Xiaodong Gu
Findings of the Association for Computational Linguistics: EMNLP 2026
Large Reasoning Models (LRMs) have demonstrated remarkable capabilities by scaling up the length of Chain-of-Thought (CoT). However, excessively long reasoning traces pose substantial challenges for training cost and inference latency. While various CoT compression approaches have emerged to address this challenge, they face inherent trade-offs: token-level methods often disrupt syntactic and logical coherence, while step-level methods based on perplexity fail to reliably capture the logically critical reasoning steps because of the dilution of logical information. In this paper, we propose ASAP (Anchor-guided, SurprisAl-based Pruning), a novel coarse-to-fine framework for CoT compression. ASAP first performs anchor-guided pruning to preserve the core reasoning structure, which efficiently reduces the search space for subsequent processing. Leveraging the insight that logical branching choices are concentrated at the onset of reasoning steps, it then enables logic-aware pruning by selecting logically essential reasoning steps based on a novel first-token surprisal metric. Finally, ASAP distills these concise CoTs into target models so they can generate efficient reasoning traces at inference time. Experiments across math and code benchmarks show that ASAP preserves competitive accuracy while substantially reducing generated tokens, latency, and training cost, with additional validation on Qwen3 confirming its cross-model applicability.
GlimpRouter: Efficient Collaborative Inference by Glimpsing One Token of Thoughts
Wenhao Zeng | Xuteng Zhang | Yuling Shi | Chao Hu | Yuting Chen | Beijun Shen | Xiaodong Gu
Findings of the Association for Computational Linguistics: ACL 2026
Wenhao Zeng | Xuteng Zhang | Yuling Shi | Chao Hu | Yuting Chen | Beijun Shen | Xiaodong Gu
Findings of the Association for Computational Linguistics: ACL 2026
Large Reasoning Models (LRMs) achieve remarkable performance by explicitly generating multi-step chains of thought, but this capability incurs substantial inference latency and computational cost. Collaborative inference offers a promising solution by selectively allocating work between lightweight and large models, yet a fundamental challenge remains: determining when a reasoning step requires the capacity of a large model or the efficiency of a small model. Existing routing strategies either rely on local token probabilities or post-hoc verification, introducing significant inference overhead. In this work, we propose a novel perspective on step-wise collaboration: the difficulty of a reasoning step can be inferred from its very first token. Inspired by the “Aha Moment” phenomenon in LRMs, we show that the entropy of the initial token serves as a strong predictor of step difficulty. Building on this insight, we introduce GlimpRouter, a training-free step-wise collaboration framework. GlimpRouter employs a lightweight model to generate only the first token of each reasoning step and routes the step to a larger model only when the initial token entropy exceeds a threshold. Experiments on multiple benchmarks demonstrate that our approach significantly reduces inference latency while preserving accuracy. For instance, GlimpRouter attains a substantial 10.7% improvement in accuracy while reducing inference latency by 25.9% compared to a standalone large model on AIME25. These results suggest a simple yet effective mechanism for reasoning: allocating computation based on a glimpse of thought rather than full-step evaluation.
ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction
Zichun Guo | Yuling Shi | Wenhao Zeng | Chao Hu | Haotian Lin | Terry Yue Zhuo | Jiawei Chen | Xiaodong Gu | Wenping Ma
Findings of the Association for Computational Linguistics: ACL 2026
Zichun Guo | Yuling Shi | Wenhao Zeng | Chao Hu | Haotian Lin | Terry Yue Zhuo | Jiawei Chen | Xiaodong Gu | Wenping Ma
Findings of the Association for Computational Linguistics: ACL 2026
Multimodal Large Language Models (MLLMs) have achieved remarkable performance in Visually Rich Document Understanding (VRDU) tasks, but their capabilities are mainly evaluated on pristine, well-structured document images. We consider document reconstruction from shredded fragments, a challenging VRDU setting that requires integrating visual pattern recognition with semantic reasoning under significant content discontinuities. To facilitate systematic evaluation of complex VRDU tasks, we introduce ShredBench, a benchmark supported by an automated generation pipeline that renders fragmented documents directly from Markdown. The proposed pipeline ensures evaluation validity by allowing the flexible integration of latest or unseen textual sources to prevent training data contamination. ShredBench assesses four scenarios (English, Chinese, Code, Table) with three fragmentation granularities (8, 12, 16 pieces). Empirical evaluations on state-of-the-art MLLMs reveal a significant performance gap: The method is effective on intact documents; however, once the document is shredded, restoration becomes a significant challenge, with NED dropping sharply as fragmentation increases. Our findings highlight that current MLLMs lack the fine-grained cross-modal reasoning required to bridge visual discontinuities, identifying a critical gap in robust VRDU research.
Dockerless: Environment-Free Program Verifier for Coding Agents
Wenhao Zeng | Yuling Shi | Xiaodong Gu | Chao Hu | Chaofan Wang | Yuhao Cui | Hongting Zhou | Mengnan Qi | Jianqiao Wangni | Zhaojian Yu | Shuzheng Gao | Kai Cai | Shilin He
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Wenhao Zeng | Yuling Shi | Xiaodong Gu | Chao Hu | Chaofan Wang | Yuhao Cui | Hongting Zhou | Mengnan Qi | Jianqiao Wangni | Zhaojian Yu | Shuzheng Gao | Kai Cai | Shilin He
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Program verifiers play a central role in training coding agents, including selecting trajectories for supervised fine-tuning (SFT) and providing rewards for reinforcement learning (RL). Standard execution-based verification requires running unit tests inside per-repository environments such as Docker images, incurring substantial environment setup costs. We propose Dockerless, an environment-free agentic patch verifier that evaluates generated code patches without executing them. Rather than simply matching candidate patches to references, Dockerless judges patch correctness using evidence gathered through agentic repository exploration. On a verifier evaluation benchmark, Dockerless outperforms the strongest open-source verifier by 14.3 AUC points. Using Dockerless as both the SFT trajectory filter and the RL reward enables a fully environment-free post-training pipeline. The resulting model reaches 62.0%, 50.0%, and 35.2% resolve rate on SWE-bench Verified, Multilingual, and Pro, respectively. It surpasses the Qwen3.5-9B baseline by 2.4, 8.7, and 2.9 points, matching environment-based post-training.
SWE-MEM: Learning Adaptive Memory Management for Long-Horizon Coding Agents
Shuzheng Gao | Wenhao Zeng | Zhaojian Yu | Jianqiao Wangni | Chaozheng Wang | Kai Cai | Shilin He | Michael R. Lyu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shuzheng Gao | Wenhao Zeng | Zhaojian Yu | Jianqiao Wangni | Chaozheng Wang | Kai Cai | Shilin He | Michael R. Lyu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-horizon software engineering agents often need to manage lengthy and noisy interaction histories under limited context budgets. Existing memory management methods rely on static compression workflows or rigid compression schedules, and often decouple memory decisions from task-solving performance. We present SWE-MeM, a training framework for proactive and on-demand memory management in software engineering agents. SWE-MeM provides a flexible memory tool that lets agents decide when, what, and how to compress based on trajectory state, task progress, and remaining context budget. We train agents with synthesized proactive memory-management trajectories and Memory-aware GRPO, which jointly optimizes memory management and issue resolution through memory-aware trajectory splitting and step-level credit assignment. On SWE-Bench Verified, SWE-MeM achieves 43.4% and 60.2% resolve rate with 4B and 30B models, respectively, outperforming existing memory management baselines in both performance and efficiency.