Yilun Yao
Author directory2026
ARC: Active and Reflection-driven Context Management for Long-Horizon Information Seeking Agents
Yilun Yao | Shan Huang | Elsie Dai | Zhewen Tan | Zhenyu Duan | Shousheng Jia | Yanbing Jiang | Tong Yang
Findings of the Association for Computational Linguistics: ACL 2026
Yilun Yao | Shan Huang | Elsie Dai | Zhewen Tan | Zhenyu Duan | Shousheng Jia | Yanbing Jiang | Tong Yang
Findings of the Association for Computational Linguistics: ACL 2026
Large language models are increasingly deployed as research agents for deep search and long-horizon information seeking, yet their performance often degrades as interaction histories grow. This degradation, known as context rot, reflects a failure to maintain coherent and task-relevant internal states over extended reasoning horizons. Existing approaches primarily manage context through raw accumulation or passive summarization, treating it as a static artifact and allowing early errors or misplaced emphasis to persist. Motivated by this perspective, we propose ARC, which is the first framework to systematically formulate context management as an active, reflection-driven process that treats context as a dynamic internal reasoning state during execution. ARC operationalizes this view through reflection-driven monitoring and revision, allowing agents to actively reorganize their working context when misalignment or degradation is detected. Experiments on challenging long-horizon information-seeking benchmarks show that ARC consistently outperforms passive context compression methods, achieving up to an 11% absolute improvement in accuracy on BrowseComp-ZH with Qwen2.5-32B-Instruct.
RealClawBench: Live OpenClaw Benchmarks from Real Developer-Agent Sessions
Zongwei Lv | Yaoming Li | Zhewen Tan | Yilun Yao | Yuxuan Tian | Lin Sun | Xiangzheng Zhang | Weihong Lin | Tong Yang | Guangxiang Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zongwei Lv | Yaoming Li | Zhewen Tan | Yilun Yao | Yuxuan Tian | Lin Sun | Xiangzheng Zhang | Weihong Lin | Tong Yang | Guangxiang Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Agent benchmarks should reflect what users actually ask deployed agents to do, yet existing benchmarks often miss the realism of real developer-agent sessions. We introduce RealClawBench, a live benchmark framework built from real OpenClaw sessions to capture the distribution, diversity, and real-world difficulty of deployed agent use. Real user requests are challenging to benchmark because they often depend on local execution environments, involve implicit or underspecified intent, and require nontrivial verification. RealClawBench addresses these challenges with two core mechanisms: reconstructed execution environments and deterministic verifiable scorers, which together convert real sessions into reproducible, automatically scored tasks. The resulting release contains 281 executable tasks sampled from a much larger real-session pool while preserving the source distribution, with maximum final-vs-source Jensen-Shannon divergence of 0.0448. Evaluating 14 contemporary models shows that the best system solves only 65.8% of tasks, revealing substantial headroom on realistic developer-agent workloads. By turning real deployed sessions into controlled evaluation instances, RealClawBench provides a practical path toward benchmarks that better measure agent capability in actual use.