Zhuofeng Li
Author directory2026
ClawBench: Can AI Agents Complete Everyday Online Tasks?
Yuxuan Zhang | Yubo Wang | Yipeng Zhu | Penghui Du | Junwen Miao | Xuan Lu | Zhuofeng Li | Xingwei Qu | Zhengkang Guo | Yuanzhe Shen | Dingjie Song | Han Zhou | Tuney Zheng | Xian Wu | Hao Yu | Songcheng Cai | Yi Lu | Yunzhuo Hao | Minyi Lei | Liang Chen | Kai Zou | Huifeng Yin | Wendong XU | Dongfu Jiang | Ping Nie | Jiaheng Liu | Wenhu Chen | Kelsey R Allen
Findings of the Association for Computational Linguistics: EMNLP 2026
Yuxuan Zhang | Yubo Wang | Yipeng Zhu | Penghui Du | Junwen Miao | Xuan Lu | Zhuofeng Li | Xingwei Qu | Zhengkang Guo | Yuanzhe Shen | Dingjie Song | Han Zhou | Tuney Zheng | Xian Wu | Hao Yu | Songcheng Cai | Yi Lu | Yunzhuo Hao | Minyi Lei | Liang Chen | Kai Zou | Huifeng Yin | Wendong XU | Dongfu Jiang | Ping Nie | Jiaheng Liu | Wenhu Chen | Kelsey R Allen
Findings of the Association for Computational Linguistics: EMNLP 2026
AI agents may assist with emails and documents, but can they reliably complete everyday online workflows on real websites? Everyday online tasks offer a realistic yet unsolved testbed for evaluating next-generation AI agents. To this end, we introduce ClawBench, an evaluation framework comprising 153 everyday online tasks common in daily life and work, spanning 144 platforms across 15 categories, from completing purchases and booking appointments to submitting job applications. These tasks require capabilities beyond existing benchmarks, such as obtaining relevant information from user-provided documents, navigating multi-step workflows across diverse platforms, and write-heavy operations like filling in many detailed forms correctly. Unlike existing benchmarks that evaluate agents in offline sandboxes with static pages, ClawBench operates on production websites, preserving the full complexity, dynamic nature, and interaction challenges of real-world web environments. An interception layer captures and blocks the final submission request, ensuring safe evaluation without real-world side effects. Our evaluations of 8 frontier models show that both proprietary and open-source models complete only a small portion of these tasks. For example, Claude Sonnet 4.6 achieves only 33.3%, which exposes gaps in current AI agents. Progress on ClawBench brings us closer to AI agents that can function as general-purpose assistants.
Masking Stale Observations Helps Search Agents — Until It Doesn’t: A Regime Map and Its Mechanism
Haoxiang Zhang | Qixin Xu | Zhuofeng Li | Lei Zhang | Pengcheng Jiang | Yu Zhang | Julian McAuley
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Haoxiang Zhang | Qixin Xu | Zhuofeng Li | Lei Zhang | Pengcheng Jiang | Yu Zhang | Julian McAuley
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-horizon search agents accumulate large amounts of retrieved content across many tool calls, making context-budget efficiency increasingly important. A minimal intervention is to mask stale observations from the context as the trajectory progresses, but it remains unclear when this form of context management helps and why. We study observation masking through a systematic sweep over various agent backbones (4B to 284B parameters) and three retrievers on offline and live-web agentic search benchmarks. We find that the accuracy gain from masking follows an asymmetric inverted-U shape when plotted against the model’s accuracy without context management: a plateau under weak retrievers, a peak in the *mismatch regime* (strong retriever × mid-capacity model), and a sharp collapse when the model is saturated. This pattern reflects the interaction between retriever recall and the model’s implicit filtering capacity, rather than either factor in isolation. Mechanistically, masking implements a token-for-turn trade-off: it removes observations the model has largely stopped attending to and pages the agent rarely re-opens. The added turns help when they convert failures into successes, but they fail when masking removes evidence the model would otherwise have used. We therefore reframe context management as a regime-dependent intervention (rather than a default choice), providing a new, holistic viewpoint that unifies the understanding of agentic deep search.
OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis
Zhuofeng Li | Dongfu Jiang | Xueguang Ma | Haoxiang Zhang | Ping Nie | Yuyu Zhang | Kai Zou | Jianwen Xie | Yu Zhang | Wenhu Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhuofeng Li | Dongfu Jiang | Xueguang Ma | Haoxiang Zhang | Ping Nie | Yuyu Zhang | Kai Zou | Jianwen Xie | Yu Zhang | Wenhu Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Training deep research agents requires long-horizon trajectories that interleave search, evidence aggregation, and multi-step reasoning. However, existing data collection pipelines typically rely on proprietary web APIs, making large-scale trajectory synthesis costly, unstable, and difficult to reproduce. We present OpenResearcher, a reproducible pipeline that decouples one-time corpus bootstrapping from multi-turn trajectory synthesis and executes the search-and-browse loop entirely offline using three explicit browser primitives: search, open, and find, over a 15M-document corpus. Using GPT-OSS-120B as the teacher model, we synthesize over 97K trajectories, including a substantial long-horizon tail with 100+ tool calls. Supervised fine-tuning a 30B-A3B backbone on these trajectories achieves 54.8% accuracy on BrowseComp-Plus, an absolute improvement of 34.0 percentage points over the base model, while remaining competitive on BrowseComp, GAIA, and xbench-DeepSearch. Because the environment is offline and fully instrumented, it also enables controlled analysis, where our study reveals practical insights into deep research pipeline design, including data filtering strategies, agent configuration choices, and how retrieval success relates to final answer accuracy.
ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Agents
Zhuofeng Li | Yi Lu | Dongfu Jiang | Haoxiang Zhang | Yuyang Bai | Chuan Li | Yu Wang | Shuiwang Ji | Jianwen Xie | Yu Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhuofeng Li | Yi Lu | Dongfu Jiang | Haoxiang Zhang | Yuyang Bai | Chuan Li | Yu Wang | Shuiwang Ji | Jianwen Xie | Yu Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The rapid rise in AI conference submissions has driven increasing exploration of large language models (LLMs) for peer review support. However, LLM-based reviewers often generate superficial, formulaic comments lacking substantive, evidence-grounded feedback. We attribute this to the underutilization of two key components of human reviewing: explicit rubrics and contextual grounding in existing work. To address this, we introduce ReviewBench, a benchmark evaluating review text according to paper-specific rubrics derived from official guidelines, the paper’s content, and human-written reviews. We further propose ReviewGrounder, a rubric-guided, tool-integrated multi-agent framework that decomposes reviewing into drafting and grounding stages, enriching shallow drafts via targeted evidence consolidation. Experiments on ReviewBench show that ReviewGrounder, using a Phi-4-14B-based drafter and a GPT-OSS-120B-based grounding stage, consistently outperforms baselines with substantially stronger/larger backbones (e.g., GPT-4.1 and DeepSeek-R1-670B) in both alignment with human judgments and rubric-based review quality across 8 dimensions. The code is available at https://github.com/EigenTom/ReviewGrounder.
Search
Fix author
Co-authors
- Dongfu Jiang 3
- Haoxiang Zhang 3
- Yu Zhang 3
- Wenhu Chen 2
- Yi Lu 2
- Ping Nie 2
- Jianwen Xie 2
- Kai Zou 2
- Kelsey R Allen 1
- Yuyang Bai 1
- Songcheng Cai 1
- Liang Chen 1
- Penghui Du 1
- Zhengkang Guo 1
- Yunzhuo Hao 1
- Shuiwang Ji 1
- Pengcheng Jiang 1
- Minyi Lei 1
- Chuan Li 1
- Jiaheng Liu 1
- Xuan Lu 1
- Xueguang Ma 1
- Julian McAuley 1
- Junwen Miao 1
- Xingwei Qu 1
- Yuanzhe Shen 1
- Dingjie Song 1
- Yu Wang 1
- Yubo Wang 1
- Xian Wu 1
- Wendong XU 1
- Qixin Xu 1
- Huifeng Yin 1
- Hao Yu 1
- Lei Zhang 1
- Yuxuan Zhang 1
- Yuyu Zhang 1
- Tianyu Zheng 1
- Han Zhou 1
- Yipeng Zhu 1