Hang Yan
Author directoryOther people with similar names: Hang Yan
Unverified author pages with similar names: Hang Yan
2026
MMG2Skill: Can Agents Distill In-the-Wild Guides into Self-Evolving Skills?
Xinyu Che | Junqi Xiong | Yunfei Ge | Xinping Lei | Shihao Li | Hang Yan | Han Li | Yuanxing Zhang | Zhiqi Bai | Jinghua Hao | Ming Sun | Han Li | Jiaheng Liu
Findings of the Association for Computational Linguistics: EMNLP 2026
Xinyu Che | Junqi Xiong | Yunfei Ge | Xinping Lei | Shihao Li | Hang Yan | Han Li | Yuanxing Zhang | Zhiqi Bai | Jinghua Hao | Ming Sun | Han Li | Jiaheng Liu
Findings of the Association for Computational Linguistics: EMNLP 2026
Abundant procedural knowledge on the Web holds great potential for helping agents solve long-horizon tasks. However, such knowledge is often multimodal, heterogeneous, noisy, and implicitly assumes human executors, making it difficult to use directly as the skills required by agents. To bridge the gap between human-oriented guides and agent-executable skills, we formalize this problem as guide-to-skill learning: converting in-the-wild guides into executable skills and continuously improving them from trajectories observable to the agent. To evaluate the capability of existing agents on this task, we introduce MMG2Skill-Bench, the first benchmark designed for this problem. We further propose MMG2Skill, a closed-loop framework that compiles guides into editable skills, conditions a fixed vision-language model (VLM) agent on these skills during execution, and revises the skills from trajectory-level root-cause feedback without using benchmark scores. Across GUI control, open-ended gameplay, and strategic card play with six VLM backbones, MMG2Skill consistently outperforms vanilla baseline agents in every model–domain setting, achieving macro-average gains of +12.8 to +25.3 percentage points across backbones. Ablation studies show that directly prompting agents with raw guides can degrade performance, while both structured skill construction and trajectory-driven revision are necessary for the observed improvements. On success-inferable tasks, analyzer-based early stopping further prevents late-stage performance regressions and saves 25%–53% of attempts when the success signal is properly calibrated.
TIDE: Trajectory-based Diagnostic Evaluation of Test-Time Improvement in LLM Agents
Hang Yan | Xinyu Che | Fangzhi Xu | Qiushi Sun | Zichen Ding | Kanzhi Cheng | Jian Zhang | Tao Qin | Jun Liu | Qika Lin
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hang Yan | Xinyu Che | Fangzhi Xu | Qiushi Sun | Zichen Ding | Kanzhi Cheng | Jian Zhang | Tao Qin | Jun Liu | Qika Lin
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent advances in autonomous LLM agents demonstrate their ability to improve performance through iterative interaction with the environment. We define this paradigm as Test-Time Improvement (TTI). However, the mechanisms under how and why TTI succeed or fail remain poorly understood, and existing evaluation metrics fail to capture their task optimization efficiency, behavior adaptation after erroneous actions, and the specific utility of working memory. To address these gaps, we propose Test-time Improvement Diagnostic Evaluation (TIDE), a lightweight, agent-agnostic and environment-agnostic framework that decomposes TTI into three comprehensive and interconnected dimensions. The framework measures (1) the overall temporal dynamics of task completion and (2) identifies whether performance is constrained by recursive looping behaviors or (3) by burdensome accumulated memory. Through extensive experiments, TIDE highlights that improving agent performance calls for explicitly optimizing the interaction dynamics between the agent and the environment.
MVP: Multi-View-Guided Token Pruning for Vision-Language Models
Chenxi Wang | Dexing Zhong | Siyu Shi | Bowen Ping | Hang Yan | Huayang Li | Huikai Shao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chenxi Wang | Dexing Zhong | Siyu Shi | Bowen Ping | Hang Yan | Huayang Li | Huikai Shao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Vision-Language Models (VLMs) achieve strong multimodal understanding by encoding images as sequences of visual tokens, yet cost hundreds and thousands of tokens per image. Existing pruning methods often rely on a single criterion, capturing only a partial view of token necessity. Controlled experiments reveal that token necessity is multi-faceted, requiring the joint exploitation of heterogeneous pruning perspectives. To address this, we propose **MVP-Token**, a novel Multi-View-Guided Token Pruning method to learn token necessity from multiple complementary pruning perspectives. We first establish a dataset **MVP-PruneSet**, which encompasses diverse pruning criteria by running orthogonal pruning methods, including a novel question-guided method **GRASP** at the encoder side. We then propose **MVP-Pruner** to capture such multi-view supervision signals. Specifically, a lightweight dual-attention module predicts soft token-importance scores under multi-view guidance. Extensive experiments demonstrate the effectiveness of MVP-Token across different model architectures. On LLaVA-1.5-7B, our method can surpass the single-view baseline by a clear margin. On Qwen2.5-VL-7B, our method achieves a 1.33× speedup and a 24.6% latency reduction under dynamic resolution and surpasses VisionZip by 1.87% of the average performance over two retention ratios.
MUR: Momentum Uncertainty guided Reasoning for Large Language Models
Hang Yan | Fangzhi Xu | Rongman Xu | Yifei Li | Jian Zhang | Haoran Luo | Xiaobao Wu | Anh Tuan Luu | Haiteng Zhao | Qika Lin | Jun Liu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Hang Yan | Fangzhi Xu | Rongman Xu | Yifei Li | Jian Zhang | Haoran Luo | Xiaobao Wu | Anh Tuan Luu | Haiteng Zhao | Qika Lin | Jun Liu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Models (LLMs) have achieved impressive performance on reasoning-intensive tasks, yet optimizing their reasoning efficiency remains an open challenge. While Test-Time Scaling (TTS) improves reasoning quality, it often leads to overthinking—wasting tokens on redundant computations. This work investigates how to efficiently and adaptively guide LLM TTS without additional training. Inspired by the concept of momentum in physics, we propose Momentum Uncertainty-guided Reasoning (MUR), which dynamically allocates thinking budgets to critical reasoning steps by tracking and aggregating step-wise uncertainty over time. To support flexible inference-time control, we introduce -control, a simple mechanism that tunes the reasoning budget via a single hyperparameter. We provide in-depth theoretical proof to support the superiority of MUR in terms of stability and biases. MUR is comprehensively evaluated against various TTS methods across four challenging benchmarks (MATH-500, AIME24, AIME25, and GPQA-diamond) using different sizes of recent Qwen3 models (1.7B, 4B, and 8B). Results demonstrate that MUR reduces computation by over 45% on average while improving accuracy by 0.33–3.46%.
2025
𝜙-Decoding: Adaptive Foresight Sampling for Balanced Inference-Time Exploration and Exploitation
Fangzhi Xu | Hang Yan | Chang Ma | Haiteng Zhao | Jun Liu | Qika Lin | Zhiyong Wu
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Fangzhi Xu | Hang Yan | Chang Ma | Haiteng Zhao | Jun Liu | Qika Lin | Zhiyong Wu
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Inference-time optimization scales computation to derive deliberate reasoning steps for effective performance. While previous search-based strategies address the short-sightedness of auto-regressive generation, the vast search space leads to excessive exploration and insufficient exploitation. To strike an efficient balance to derive the optimal step, we frame the decoding strategy as foresight sampling, leveraging simulated future steps to obtain globally optimal step estimation. Built on it, we propose a novel decoding strategy, named 𝜙-Decoding. To provide a precise and expressive estimation of step value, 𝜙-Decoding approximates two distributions via foresight and clustering. Sampling from the joint distribution, the optimal steps can be selected for exploitation. To support adaptive computation allocation, we propose in-width and in-depth pruning strategies, featuring a light-weight solution to achieve inference efficiency. Extensive experiments across seven benchmarks show 𝜙-Decoding outperforms strong baselines in both performance and efficiency. Additional analysis demonstrates its generalization across various LLMs and scalability across a wide range of computing budgets.
Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoning
Fangzhi Xu | Hang Yan | Chang Ma | Haiteng Zhao | Qiushi Sun | Kanzhi Cheng | Junxian He | Jun Liu | Zhiyong Wu
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Fangzhi Xu | Hang Yan | Chang Ma | Haiteng Zhao | Qiushi Sun | Kanzhi Cheng | Junxian He | Jun Liu | Zhiyong Wu
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Advancing LLM reasoning skills has captivated wide interest. However, current post-training techniques rely heavily on supervisory signals, such as outcome supervision or auxiliary reward models, which face the problem of scalability and high annotation costs. This motivates us to enhance LLM reasoning without the need for external supervision. Given the input query, the LLM seeks the globally optimal response by stepwise sampling and self-rewarding, and optimizes itself with the collected responses. Genius offers some technical solutions to address the following key challenges. To tackle the problem of how to determine the steps in the response via self-rewarding, Genius introduces a stepwise foresight re-sampling strategy to sample and estimate the step value by simulating future outcomes. Recognizing the intrinsic noise and uncertainty of self-supervision, we propose an advantage-calibrated optimization (ACO) loss function to mitigate estimation inconsistencies. In short, Genius provides an advanced initial step towards self-improve LLM reasoning with general queries and without supervision, revolutionizing reasoning scaling laws given the vast availability of general queries.
Search
Fix author
Co-authors
- Jun Liu 4
- Fangzhi Xu 4
- Qika Lin 3
- Haiteng Zhao 3
- Xinyu Che 2
- Kanzhi Cheng 2
- Chang Ma 2
- Qiushi Sun 2
- Zhiyong Wu 2
- Jian Zhang 2
- Zhiqi Bai 1
- Zichen Ding 1
- Yunfei Ge 1
- Jinghua Hao 1
- Junxian He 1
- Xinping Lei 1
- Han Li 1
- Han Li 1
- Huayang Li 1
- Shihao Li 1
- Yifei Li 1
- Jiaheng Liu 1
- Haoran Luo 1
- Bowen Ping 1
- Tao Qin 1
- Huikai Shao 1
- Siyu Shi 1
- Ming Sun 1
- Luu Anh Tuan 1
- Chenxi Wang 1
- Xiaobao Wu 1
- Junqi Xiong 1
- Rongman Xu 1
- Yuanxing Zhang 1
- Dexing Zhong 1