Qi Zhang
Author directoryOther people with similar names: Qi Zhang, QI Zhang, Qi Zhang, Qi Zhang, Qi Zhang, Qi Zhang, Qi Zhang, Qi Zhang, Qi Zhang, Qi Zhang, Qi Zhang
Unverified author pages with similar names: Qi Zhang
2026
AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoning
Honglin Guo | Qi Zhang | Yu Zhang | Weijie Li | Rui Zheng | Zhikai Lei | Qiyuan Peng | Zhiheng Xi | Tao Gui | Qi Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Honglin Guo | Qi Zhang | Yu Zhang | Weijie Li | Rui Zheng | Zhikai Lei | Qiyuan Peng | Zhiheng Xi | Tao Gui | Qi Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models are increasingly deployed as agents that reason over documents rather than answer from parametric knowledge. We study _archive-grounded reasoning_: locating sparse evidence across a large, messy collection of workplace files, reconciling inconsistent terminology, units, and time conventions, and computing an answer. Existing benchmarks address only parts of this setting and none jointly stresses archive-groundedness, agentic exploration, and cross-domain coverage. We introduce **Agora**, a benchmark pairing 362 questions with eight domain collections of 9,664 authentic documents and 372M tokens, far exceeding any model’s context window, so agents must explore deliberately rather than scan exhaustively. Agora is built by an agentic pipeline combining cross-document task synthesis, leakage-preventing obfuscation, and difficulty filtering. Evaluating eight models, we find the task far from solved: even the strongest reaches only 59.4% accuracy, with notable variation across domains.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
Zhiheng Xi | Dingwen Yang | Jiaqi Liu | Jixuan Huang | Honglin Guo | Baodai Huang | Tinggang Chen | Qi Zhang | Zhonghang Lu | Chenyu Liu | Jiajun Sun | Jiazheng Zhang | Dingwei Zhu | Xin Guo | Junzhe Wang | Zhihao Zhang | Yuming Yang | Junjie Ye | Minghe Gao | Dongrui Liu | Jiaming Ji | Guohao Li | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhiheng Xi | Dingwen Yang | Jiaqi Liu | Jixuan Huang | Honglin Guo | Baodai Huang | Tinggang Chen | Qi Zhang | Zhonghang Lu | Chenyu Liu | Jiajun Sun | Jiazheng Zhang | Dingwei Zhu | Xin Guo | Junzhe Wang | Zhihao Zhang | Yuming Yang | Junjie Ye | Minghe Gao | Dongrui Liu | Jiaming Ji | Guohao Li | Tao Gui | Qi Zhang | Xuanjing Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Language agents, i.e., LLM agents, progress rapidly and are increasingly deployed in production environments. This trend underscores the urgent need for rigorous and realistic evaluations. However, most existing benchmarks evaluate agents in simplified, idealized settings. They typically rely on pre-packaged tool interfaces, overlook critical steps, and assume inputs are clean and fully specified. Consequently, they understate the difficulty of real deployments, where uncertainty and noise are ubiquitous and agents must proactively explore the environment to uncover new tools. To bridge this gap, we present AgentGym2, a new evaluation framework with task instances grounded in real-world end-to-end working demands. Beyond reasoning and planning, it measures agents’ ability to execute end-to-end procedures, discover tools via exploration, compose tools for unseen tasks, and remain robust to noisy and underspecified information. Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2, revealing a substantial gap between the capability of current agents and the demands of real-world applications.
Search
Fix author
Co-authors
- Tao Gui 2
- Honglin Guo 2
- Zhiheng Xi 2
- Qi Zhang 2
- Tinggang Chen 1
- Minghe Gao 1
- Xin Guo 1
- Baodai Huang 1
- Jixuan Huang 1
- Xuan-Jing Huang (黄萱菁) 1
- Jiaming Ji (吉嘉铭) 1
- Zhikai Lei 1
- Guohao Li 1
- Weijie Li 1
- Chenyu Liu 1
- Dongrui Liu 1
- Jiaqi Liu 1
- Zhonghang Lu 1
- Qiyuan Peng 1
- Jiajun Sun 1
- Junzhe Wang 1
- Dingwen Yang 1
- Yuming Yang 1
- Junjie Ye (叶俊杰) 1
- Jiazheng Zhang 1
- Yu Zhang 1
- Zhihao Zhang 1
- Rui Zheng 1
- Dingwei Zhu 1