Zhihao Zhang
Other people with similar names: Zhihao Zhang, Zhihao Zhang (Soochow)
Unverified author pages with similar names: Zhihao Zhang
2026
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models
Hengyuan Zhang | Zhihao Zhang | Ercong Nie | Mingyang Wang | Zunhai Su | Yiwei Wang | Qianli Wang | Shuzhou Yuan | Xufeng Duan | Qibo Xue | Zeping Yu | Chenming Shang | Xiao Liang | Jing Xiong | Hui Shen | Chaofan Tao | Zhengwu Liu | Senjie Jin | Zhiheng Xi | Dongdong Zhang | Sophia Ananiadou | Tao Gui | Ruobing Xie | Hayden Kwok-Hay So | Hinrich Schuetze | Xuanjing Huang | Qi Zhang | Ngai Wong
Findings of the Association for Computational Linguistics: ACL 2026
Hengyuan Zhang | Zhihao Zhang | Ercong Nie | Mingyang Wang | Zunhai Su | Yiwei Wang | Qianli Wang | Shuzhou Yuan | Xufeng Duan | Qibo Xue | Zeping Yu | Chenming Shang | Xiao Liang | Jing Xiong | Hui Shen | Chaofan Tao | Zhengwu Liu | Senjie Jin | Zhiheng Xi | Dongdong Zhang | Sophia Ananiadou | Tao Gui | Ruobing Xie | Hayden Kwok-Hay So | Hinrich Schuetze | Xuanjing Huang | Qi Zhang | Ngai Wong
Findings of the Association for Computational Linguistics: ACL 2026
Mechanistic Interpretability (MI) has emerged as a vital approach to demystify the opaque decision-making of Large Language Models (LLMs). However, existing reviews primarily treat MI as an observational science, summarizing analytical insights while lacking a systematic framework for actionable intervention. To bridge this gap, we present a practical survey structured around the pipeline: "Locate, Steer, and Improve." We formally categorize Localizing (diagnosis) and Steering (intervention) methods based on specific Interpretable Objects to establish a rigorous intervention protocol. Furthermore, we demonstrate how this framework enables tangible improvements in Alignment, Capability, and Efficiency, effectively operationalizing MI as a practical engineering toolkit for model optimization. The curated paper list of this work is available at https://anonymous.4open.science/r/Act-MI-F068.
LLMEval-Fair: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models
Ming Zhang | Yujiong Shen | Jingyi Deng | Yuhui Wang | Huayu Sha | Kexin Tan | Qiyuan Peng | Yue Zhang | Junzhe Wang | Shichun Liu | Yueyuan Huang | Jingqi Tong | Changhao Jiang | Yilong Wu | Zhihao Zhang | Mingqi Wu | Mingxu Chai | Zhiheng Xi | Shihan Dou | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Ming Zhang | Yujiong Shen | Jingyi Deng | Yuhui Wang | Huayu Sha | Kexin Tan | Qiyuan Peng | Yue Zhang | Junzhe Wang | Shichun Liu | Yueyuan Huang | Jingqi Tong | Changhao Jiang | Yilong Wu | Zhihao Zhang | Mingqi Wu | Mingxu Chai | Zhiheng Xi | Shihan Dou | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Existing evaluation of Large Language Models (LLMs) on static benchmarks is vulnerable to data contamination and leaderboard overfitting, critical issues that obscure true model capabilities. To address this, we introduce LLMEval-Fair, a framework for dynamic evaluation of LLMs. LLMEval-Fair is built on a proprietary bank of 220k graduate-level questions, from which it dynamically samples unseen test sets for each evaluation run. Its automated pipeline ensures integrity via contamination-resistant data curation, a novel anti-cheating architecture, and a calibrated LLM-as-a-judge process achieving 90% agreement with human experts, complemented by a relative ranking system for fair comparison. An 30-month longitudinal study of nearly 60 leading models reveals a performance ceiling on knowledge memorization and exposes data contamination vulnerabilities undetectable by static benchmarks. The framework demonstrates exceptional robustness in ranking stability and consistency, providing strong empirical validation for the dynamic evaluation paradigm. LLMEval-Fair offers a robust and credible methodology for assessing the true capabilities of LLMs beyond leaderboard scores, promoting the development of more trustworthy evaluation standards.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
Zhiheng Xi | Dingwen Yang | Jiaqi Liu | Jixuan Huang | Honglin Guo | Baodai Huang | Tinggang Chen | Qi Zhang | Zhonghang Lu | Chenyu Liu | Jiajun Sun | Jiazheng Zhang | Dingwei Zhu | Xin Guo | Junzhe Wang | Zhihao Zhang | Yuming Yang | Junjie Ye | Minghe Gao | Dongrui Liu | Jiaming Ji | Guohao Li | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhiheng Xi | Dingwen Yang | Jiaqi Liu | Jixuan Huang | Honglin Guo | Baodai Huang | Tinggang Chen | Qi Zhang | Zhonghang Lu | Chenyu Liu | Jiajun Sun | Jiazheng Zhang | Dingwei Zhu | Xin Guo | Junzhe Wang | Zhihao Zhang | Yuming Yang | Junjie Ye | Minghe Gao | Dongrui Liu | Jiaming Ji | Guohao Li | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Language agents, i.e., LLM agents, progress rapidly and are increasingly deployed in production environments. This trend underscores the urgent need for rigorous and realistic evaluations. However, most existing benchmarks evaluate agents in simplified, idealized settings. They typically rely on pre-packaged tool interfaces, overlook critical steps, and assume inputs are clean and fully specified. Consequently, they understate the difficulty of real deployments, where uncertainty and noise are ubiquitous and agents must proactively explore the environment to uncover new tools. To bridge this gap, we present AgentGym2, a new evaluation framework with task instances grounded in real-world end-to-end working demands. Beyond reasoning and planning, it measures agents’ ability to execute end-to-end procedures, discover tools via exploration, compose tools for unseen tasks, and remain robust to noisy and underspecified information. Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2, revealing a substantial gap between the capability of current agents and the demands of real-world applications.
Search
Fix author
Co-authors
- Tao Gui 3
- Xuan-Jing Huang (黄萱菁) 3
- Zhiheng Xi 3
- Qi Zhang 3
- Junzhe Wang 2
- Sophia Ananiadou 1
- Mingxu Chai 1
- Tinggang Chen 1
- Jingyi Deng 1
- Shihan Dou 1
- Xufeng Duan 1
- Minghe Gao 1
- Honglin Guo 1
- Xin Guo 1
- Baodai Huang 1
- Jixuan Huang 1
- Yueyuan Huang 1
- Jiaming Ji 1
- Changhao Jiang 1
- Senjie Jin 1
- Guohao Li 1
- Xiao Liang (梁霄) 1
- Chenyu Liu 1
- Dongrui Liu 1
- Jiaqi Liu 1
- Shichun Liu 1
- Zhengwu Liu 1
- Zhonghang Lu 1
- Ercong Nie 1
- Qiyuan Peng 1
- Hinrich Schuetze 1
- Huayu Sha 1
- Chenming Shang 1
- Hui Shen 1
- Yujiong Shen 1
- Hayden Kwok-Hay So 1
- Zunhai Su 1
- Jiajun Sun 1
- Kexin Tan 1
- Chaofan Tao 1
- Jingqi Tong 1
- Mingyang Wang 1
- Qianli Wang 1
- Yiwei Wang 1
- Yuhui Wang 1
- Ngai Wong 1
- Mingqi Wu 1
- Yilong Wu 1
- Ruobing Xie 1
- Jing Xiong 1
- Qibo Xue 1
- Dingwen Yang 1
- Yuming Yang 1
- Junjie Ye (叶俊杰) 1
- Zeping Yu 1
- Shuzhou Yuan 1
- Dongdong Zhang 1
- Hengyuan Zhang 1
- Jiazheng Zhang 1
- Ming Zhang 1
- Qi Zhang 1
- Yue Zhang 1
- Dingwei Zhu 1