Zhengkang Guo
Author directory2026
ClawBench: Can AI Agents Complete Everyday Online Tasks?
Yuxuan Zhang | Yubo Wang | Yipeng Zhu | Penghui Du | Junwen Miao | Xuan Lu | Zhuofeng Li | Xingwei Qu | Zhengkang Guo | Yuanzhe Shen | Dingjie Song | Han Zhou | Tuney Zheng | Xian Wu | Hao Yu | Songcheng Cai | Yi Lu | Yunzhuo Hao | Minyi Lei | Liang Chen | Kai Zou | Huifeng Yin | Wendong XU | Dongfu Jiang | Ping Nie | Jiaheng Liu | Wenhu Chen | Kelsey R Allen
Findings of the Association for Computational Linguistics: EMNLP 2026
Yuxuan Zhang | Yubo Wang | Yipeng Zhu | Penghui Du | Junwen Miao | Xuan Lu | Zhuofeng Li | Xingwei Qu | Zhengkang Guo | Yuanzhe Shen | Dingjie Song | Han Zhou | Tuney Zheng | Xian Wu | Hao Yu | Songcheng Cai | Yi Lu | Yunzhuo Hao | Minyi Lei | Liang Chen | Kai Zou | Huifeng Yin | Wendong XU | Dongfu Jiang | Ping Nie | Jiaheng Liu | Wenhu Chen | Kelsey R Allen
Findings of the Association for Computational Linguistics: EMNLP 2026
AI agents may assist with emails and documents, but can they reliably complete everyday online workflows on real websites? Everyday online tasks offer a realistic yet unsolved testbed for evaluating next-generation AI agents. To this end, we introduce ClawBench, an evaluation framework comprising 153 everyday online tasks common in daily life and work, spanning 144 platforms across 15 categories, from completing purchases and booking appointments to submitting job applications. These tasks require capabilities beyond existing benchmarks, such as obtaining relevant information from user-provided documents, navigating multi-step workflows across diverse platforms, and write-heavy operations like filling in many detailed forms correctly. Unlike existing benchmarks that evaluate agents in offline sandboxes with static pages, ClawBench operates on production websites, preserving the full complexity, dynamic nature, and interaction challenges of real-world web environments. An interception layer captures and blocks the final submission request, ensuring safe evaluation without real-world side effects. Our evaluations of 8 frontier models show that both proprietary and open-source models complete only a small portion of these tasks. For example, Claude Sonnet 4.6 achieves only 33.3%, which exposes gaps in current AI agents. Progress on ClawBench brings us closer to AI agents that can function as general-purpose assistants.
Controllable Memory Usage: Balancing Anchoring and Innovation in Long-Term Human–Agent Interaction
Zisu Huang | Muzhao Tian | Xiaohua Wang | Jingwen Xu | Zhengkang Guo | Qi Qian | Kaitao Song | Jiakang Yuan | Changze Lv | Xiaoqing Zheng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zisu Huang | Muzhao Tian | Xiaohua Wang | Jingwen Xu | Zhengkang Guo | Qi Qian | Kaitao Song | Jiakang Yuan | Changze Lv | Xiaoqing Zheng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an “all-or-nothing” approach to memory usage: incorporating all relevant past information can lead to Memory Anchoring, where the agent is trapped by past interactions, while excluding memory entirely results in under-utilization and the loss of important interaction history. We show that an agent’s reliance on memory can be modeled as an explicit and user-controllable dimension. We first introduce a behavioral metric of memory dependence to quantify the influence of past interactions on current outputs. We then propose Steerable Memory Agent, SteeM, a framework that allows users to dynamically regulate memory reliance, ranging from a fresh-start mode that promotes innovation to a high-fidelity mode that closely follows interaction history. Experiments across different scenarios demonstrate that our approach consistently outperforms conventional prompting and rigid memory masking strategies, yielding a more nuanced and effective control for personalized human-agent collaboration.
Search
Fix author
Co-authors
- Kelsey R Allen 1
- Songcheng Cai 1
- Liang Chen 1
- Wenhu Chen 1
- Penghui Du 1
- Yunzhuo Hao 1
- Zisu Huang 1
- Dongfu Jiang 1
- Minyi Lei 1
- Zhuofeng Li 1
- Jiaheng Liu 1
- Xuan Lu 1
- Yi Lu 1
- Changze Lv 1
- Junwen Miao 1
- Ping Nie 1
- Qi Qian 1
- Xingwei Qu 1
- Yuanzhe Shen 1
- Dingjie Song 1
- Kaitao Song 1
- Muzhao Tian 1
- Xiaohua Wang 1
- Yubo Wang 1
- Xian Wu 1
- Wendong XU 1
- Jingwen Xu 1
- Huifeng Yin 1
- Hao Yu 1
- Jiakang Yuan 1
- Yuxuan Zhang 1
- Tianyu Zheng 1
- Xiaoqing Zheng 1
- Han Zhou 1
- Yipeng Zhu 1
- Kai Zou 1