Chenyu Liu
Author directoryOther people with similar names: Chenyu Liu, Chenyu Liu, Chenyu Liu
2026
Prefix-Adaptive Block Diffusion for Efficient Document Recognition
Mingxu Chai | Ziyu Shen | Chenyu Liu | Jihua Kang | Tao Gui | Qi Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mingxu Chai | Ziyu Shen | Chenyu Liu | Jihua Kang | Tao Gui | Qi Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Block Diffusion Models (BDMs) support parallel generation, flexible-length output, and KV caching, making them promising for efficient document parsing. However, existing BDMs bind denoising and cache commitment to fixed block boundaries: parallelism shrinks during intra-block denoising, while generated tokens cannot be cached until the whole block is completed. Moreover, intra-block bidirectional denoising conflicts with inter-block autoregression, creating inconsistent information flow that can challenge structure-sensitive recognition. We propose the Prefix-Adaptive Block Diffusion Model (PA-BDM), which replaces intra-block bidirectional denoising with causal denoising from prefix to suffix and treats the block size as a maximum candidate range rather than a fixed commitment unit. PA-BDM uses Confidence-gated Structural Loss (CSL) to build low-entropy prefixes before extending training to longer continuations. During inference, Progressive Prefix Commitment (PPC) then dynamically commits the longest reliable prefix into the KV cache and resets the next candidate range from the updated prefix, restoring a large parallel decoding space at each step. Experiments show that the 3B PA-BDM achieves higher recognition scores on several benchmarks and improves inference throughput by 71.6% over the 2.5B MinerU-Diffusion.
State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models
Mingxu Chai | Chenyu Liu | Ziyu Shen | Jiazheng Zhang | Kaidi Zhang | Jihua Kang | Tao Gui | Qi Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mingxu Chai | Chenyu Liu | Ziyu Shen | Jiazheng Zhang | Kaidi Zhang | Jihua Kang | Tao Gui | Qi Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Compared with typical vision–language tasks, document parsing places stronger demands on fine-grained visual perception. Existing vision–language model (VLM)–based parsing approaches rely on globally compressed visual tokens, where fine-grained details are entangled within a single representation and repeatedly accessed during decoding. However, we observe that the visual evidence for each prediction is typically localized and conditioned on the current decoding state, whereas such representations must be accessed in full at every decoding step, resulting in inefficient computation. To address this mismatch, we formulate perception as state-conditioned visual evidence retrieval (SCVER) during autoregressive decoding. The model operates on a compact global representation for coarse structure and retrieves a small set of relevant high-resolution regions conditioned on the current token state. This coarse-to-fine design enables on-demand access to fine-grained visual cues, relieving globally shared representations from encoding all fine-grained details. We further find that learning such state-conditioned retrieval in VLMs is challenging and unstable. To stabilize this process, we introduce a Spatially-Guided Learning Objective (SGLO) to guide the retrieval process. Experiments on document parsing benchmarks show that SCVER improves robustness under reduced input resolution and achieves a better accuracy–efficiency trade-off, demonstrating the effectiveness of on-demand visual evidence retrieval for fine-grained perception.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
Zhiheng Xi | Dingwen Yang | Jiaqi Liu | Jixuan Huang | Honglin Guo | Baodai Huang | Tinggang Chen | Qi Zhang | Zhonghang Lu | Chenyu Liu | Jiajun Sun | Jiazheng Zhang | Dingwei Zhu | Xin Guo | Junzhe Wang | Zhihao Zhang | Yuming Yang | Junjie Ye | Minghe Gao | Dongrui Liu | Jiaming Ji | Guohao Li | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhiheng Xi | Dingwen Yang | Jiaqi Liu | Jixuan Huang | Honglin Guo | Baodai Huang | Tinggang Chen | Qi Zhang | Zhonghang Lu | Chenyu Liu | Jiajun Sun | Jiazheng Zhang | Dingwei Zhu | Xin Guo | Junzhe Wang | Zhihao Zhang | Yuming Yang | Junjie Ye | Minghe Gao | Dongrui Liu | Jiaming Ji | Guohao Li | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Language agents, i.e., LLM agents, progress rapidly and are increasingly deployed in production environments. This trend underscores the urgent need for rigorous and realistic evaluations. However, most existing benchmarks evaluate agents in simplified, idealized settings. They typically rely on pre-packaged tool interfaces, overlook critical steps, and assume inputs are clean and fully specified. Consequently, they understate the difficulty of real deployments, where uncertainty and noise are ubiquitous and agents must proactively explore the environment to uncover new tools. To bridge this gap, we present AgentGym2, a new evaluation framework with task instances grounded in real-world end-to-end working demands. Beyond reasoning and planning, it measures agents’ ability to execute end-to-end procedures, discover tools via exploration, compose tools for unseen tasks, and remain robust to noisy and underspecified information. Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2, revealing a substantial gap between the capability of current agents and the demands of real-world applications.
Search
Fix author
Co-authors
- Tao Gui 3
- Qi Zhang 3
- Mingxu Chai 2
- Jihua Kang 2
- Ziyu Shen 2
- Jiazheng Zhang 2
- Tinggang Chen 1
- Minghe Gao 1
- Honglin Guo 1
- Xin Guo 1
- Baodai Huang 1
- Jixuan Huang 1
- Xuan-Jing Huang (黄萱菁) 1
- Jiaming Ji (吉嘉铭) 1
- Guohao Li 1
- Dongrui Liu 1
- Jiaqi Liu 1
- Zhonghang Lu 1
- Jiajun Sun 1
- Junzhe Wang 1
- Zhiheng Xi 1
- Dingwen Yang 1
- Yuming Yang 1
- Junjie Ye (叶俊杰) 1
- Kaidi Zhang 1
- Qi Zhang 1
- Zhihao Zhang 1
- Dingwei Zhu 1