Chaoyun Zhang
Author directory2026
WebXSkill: Skill Learning for Autonomous Web Agents
Zhaoyang Wang | Qianhui Wu | Xuchao Zhang | Chaoyun Zhang | Wenlin Yao | Fazle Elahi Faisal | Baolin Peng | Si Qin | Suman Nath | Qingwei Lin | Chetan Bansal | Dongmei Zhang | Saravan Rajmohan | Jianfeng Gao | Huaxiu Yao
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhaoyang Wang | Qianhui Wu | Xuchao Zhang | Chaoyun Zhang | Wenlin Yao | Fazle Elahi Faisal | Baolin Peng | Si Qin | Suman Nath | Qingwei Lin | Chetan Bansal | Dongmei Zhang | Saravan Rajmohan | Jianfeng Gao | Huaxiu Yao
Findings of the Association for Computational Linguistics: EMNLP 2026
Autonomous web agents powered by large language models (LLMs) remain brittle on long-horizon browser workflows. A key bottleneck is a grounding gap in existing skill formulations: textual workflow skills provide natural language guidance but cannot be directly executed, while code-based skills execute without giving the agent step-level guidance for adaptation or recovery. We introduce WebXSkill, a framework that bridges this gap with executable skills, each pairing a parameterized action program with step-level natural-language guidance. WebXSkill operates in three stages: skill extraction mines reusable action subsequences from readily available synthetic agent trajectories and abstracts them into parameterized skills, skill organization indexes them into a URL-based graph for context-aware retrieval, and skill deployment exposes two complementary modes, grounded mode for fully automated execution and guided mode where skills serve as step-by-step instructions the agent follows with its native planning. WebXSkill demonstrates consistent improvements on WebArena, WebVoyager, and Online-Mind2Web. We further find that better skill deployment mode depends on a model’s plan and execution capability. The code is available at https://github.com/aiming-lab/WebXSkill.
Zipage: Maintain High Request Concurrency for LLM Reasoning through Compressed PagedAttention
Mengqi Liao | Lu Wang | Chaoyun Zhang | Bo Qiao | Si Qin | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang | Huaiyu Wan
Findings of the Association for Computational Linguistics: ACL 2026
Mengqi Liao | Lu Wang | Chaoyun Zhang | Bo Qiao | Si Qin | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang | Huaiyu Wan
Findings of the Association for Computational Linguistics: ACL 2026
With reasoning becoming the generative paradigm for large language models, the memory bottleneck caused by KV cache during the inference phase has become a critical factor limiting high-concurrency service capabilities. Although existing KV cache eviction methods address the memory issue, most of them are impractical for industrial-grade applications. This paper introduces Compressed PagedAttention, a method that combines token-wise KV cache eviction with PagedAttention. We propose a comprehensive scheduling strategy and support prefix caching and asynchronous compression for Compressed PagedAttention. Based on this, we have developed a high-concurrency inference engine, Zipage. On large-scale mathematical reasoning tasks, Zipage achieves around 95% of the performance of Full KV inference engines while delivering over 2.1 speedup.
GUI-360° : A Comprehensive Dataset and Benchmark for Desktop Productivity Computer-Using Agents
Jian Mu | Chaoyun Zhang | Chiming Ni | Lu Wang | Bo Qiao | Kartik Mathur | Qianhui Wu | Yuhang Xie | Xiaojun Ma | Mengyu Zhou | Si Qin | Liqun Li | Yu Kang | Minghua Ma | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jian Mu | Chaoyun Zhang | Chiming Ni | Lu Wang | Bo Qiao | Kartik Mathur | Qianhui Wu | Yuhang Xie | Xiaojun Ma | Mengyu Zhou | Si Qin | Liqun Li | Yu Kang | Minghua Ma | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
We introduce GUI-360°, a large-scale dataset and benchmark suite for desktop productivity computer-using agents (CUAs). GUI-360° provides an automated pipeline for query sourcing, template-based environment construction, task instantiation, batched execution, and LLM-assisted quality filtering in Windows office applications. The corpus contains 131K validated successful action steps across 17K trajectories for training and evaluation, together with 1.09M failed execution steps for failure analysis and future recovery training. Each step provides screenshots, accessibility metadata, instantiated goals, reasoning traces, and structured GUI/API actions. GUI-360° supports GUI grounding, screen parsing, and action prediction under a hybrid GUI+API action space. Experiments show that current vision–language models struggle with fine-grained grounding and stepwise action prediction, while supervised fine-tuning on GUI-360° brings consistent in-domain and external benchmark gains. Our code and dataset are available at https://github.com/2020-qqtcg/GUI-360 and https://huggingface.co/datasets/vyokky/GUI-360.
2025
UFO: A UI-Focused Agent for Windows OS Interaction
Chaoyun Zhang | Liqun Li | Shilin He | Xu Zhang | Bo Qiao | Si Qin | Minghua Ma | Yu Kang | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang | Qi Zhang
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Chaoyun Zhang | Liqun Li | Shilin He | Xu Zhang | Bo Qiao | Si Qin | Minghua Ma | Yu Kang | Qingwei Lin | Saravan Rajmohan | Dongmei Zhang | Qi Zhang
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
We introduce UFO, a UI-Fcused agent designed to fulfill user requests tailored to Windows OS applications by observing and analyzing the GUI and control information of these applications. UFO utilizes a hierarchical dual-agent framework that decomposes user requests using a divide-and-conquer approach, enabling seamless navigation and addressing sub-tasks across multiple applications. It also incorporates a control interaction module tailored for Windows OS, which detects control elements effectively and allows for fully automated execution. As a result, UFO simplifies complex and time-consuming processes into tasks that can be completed with natural language commands.We conducted testing of UFO across 9 popular Windows applications, encompassing a variety of scenarios. The results derived from both quantitative metrics and real-case studies, underscore the superior effectiveness of UFOin fulfilling user requests. To the best of our knowledge, UFO stands as the first UI agent specifically tailored for task completion within the Windows OS.
DI-BENCH: Benchmarking Large Language Models on Dependency Inference with Testable Repositories at Scale
Linghao Zhang | Junhao Wang | Shilin He | Chaoyun Zhang | Yu Kang | Bowen Li | Jiaheng Wen | Chengxing Xie | Maoquan Wang | Yufan Huang | Elsie Nallipogu | Qingwei Lin | Yingnong Dang | Saravan Rajmohan | Dongmei Zhang | Qi Zhang
Findings of the Association for Computational Linguistics: ACL 2025
Linghao Zhang | Junhao Wang | Shilin He | Chaoyun Zhang | Yu Kang | Bowen Li | Jiaheng Wen | Chengxing Xie | Maoquan Wang | Yufan Huang | Elsie Nallipogu | Qingwei Lin | Yingnong Dang | Saravan Rajmohan | Dongmei Zhang | Qi Zhang
Findings of the Association for Computational Linguistics: ACL 2025
Large Language Models have advanced automated software development, however, it remains a challenge to correctly infer dependencies, namely, identifying the internal components and external packages required for a repository to successfully run. Existing studies highlight that dependency-related issues cause over 40% of observed runtime errors on the generated repository. To address this, we introduce DI-BENCH, a large-scale benchmark and evaluation framework specifically designed to assess LLMs’ capability on dependency inference. The benchmark features 581 repositories with testing environments across Python, C#, Rust, and JavaScript. Extensive experiments with textual and execution-based metrics reveal that the current best-performing model achieves only a 48% execution pass rate on Python, indicating significant room for improvement. DI-BENCH establishes a new viewpoint for evaluating LLM performance on repositories, paving the way for more robust end-to-end software synthesis.
2024
Everything of Thoughts: Defying the Law of Penrose Triangle for Thought Generation
Ruomeng Ding | Chaoyun Zhang | Lu Wang | Yong Xu | Minghua Ma | Wei Zhang | Si Qin | Saravan Rajmohan | Qingwei Lin | Dongmei Zhang
Findings of the Association for Computational Linguistics: ACL 2024
Ruomeng Ding | Chaoyun Zhang | Lu Wang | Yong Xu | Minghua Ma | Wei Zhang | Si Qin | Saravan Rajmohan | Qingwei Lin | Dongmei Zhang
Findings of the Association for Computational Linguistics: ACL 2024
This paper introduce a novel thought prompting approach called ”Everything of Thoughts” (XoT) for Large Language Models (LLMs) to defy the law of ”Penrose triangle” of existing thought paradigms, to achieve three key perspectives in thought generation simultaneously: performance, efficiency, and flexibility. XoT leverages pretrained reinforcement learning and Monte Carlo Tree Search (MCTS) to incorporate external domain knowledge and planning capability into thoughts, thereby enhancing LLMs’ decision-making capabilities. Through the MCTS-LLM collaborative thought revision framework, XoT autonomously produces high-quality comprehensive cognitive mappings with minimal LLM interactions. Additionally, XoT empowers LLMs to utilize flexible cognitive mappings for solving problems with multiple solutions.We evaluate XoT on several challenging problem-solving tasks, including Game of 24, 8-Puzzle, and Pocket Cube. Our results demonstrate that XoT significantly outperforms existing approaches in various dimensions, showcasing its remarkable proficiency in addressing complex problems across diverse domains. The data and code are available at https://github.com/microsoft/Everything-of-Thoughts-XoT.
Call Me When Necessary: LLMs can Efficiently and Faithfully Reason over Structured Environments
Sitao Cheng | Ziyuan Zhuang | Yong Xu | Fangkai Yang | Chaoyun Zhang | Xiaoting Qin | Xiang Huang | Ling Chen | Qingwei Lin | Dongmei Zhang | Saravan Rajmohan | Qi Zhang
Findings of the Association for Computational Linguistics: ACL 2024
Sitao Cheng | Ziyuan Zhuang | Yong Xu | Fangkai Yang | Chaoyun Zhang | Xiaoting Qin | Xiang Huang | Ling Chen | Qingwei Lin | Dongmei Zhang | Saravan Rajmohan | Qi Zhang
Findings of the Association for Computational Linguistics: ACL 2024
Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graphs and tables. Such tasks typically require multi-hop reasoning, i.e., match natural language utterance with instances in the environment. Previous works adopt LLMs to incrementally build a reasoning path, where LLMs either invoke tools or pick up items by step-by-step interacting with the environment. We propose Reasoning-Path-Editing (Readi), a novel framework where LLMs can efficiently and faithfully reason over structured environments. In Readi, LLMs initially generate a reasoning path given a query, and edit the path only when necessary. We instantiate the path on structured environments and provide feedback to edit the path if anything goes wrong. Experimental results on three KGQA and two TableQA datasets show the effectiveness of Readi, significantly surpassing previous LLM-based methods (by 9.1% Hit@1 on WebQSP, 12.4% on MQA-3H and 9.5% on WTQ), comparable with state-of-the-art fine-tuned methods (67% on CWQ and 74.7% on WebQSP) and substantially boosting the vanilla LLMs (by 14.9% on CWQ). Our code will be available on https://aka.ms/readi.
QueryAgent: A Reliable and Efficient Reasoning Framework with Environmental Feedback based Self-Correction
Xiang Huang | Sitao Cheng | Shanshan Huang | Jiayu Shen | Yong Xu | Chaoyun Zhang | Yuzhong Qu
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Xiang Huang | Sitao Cheng | Shanshan Huang | Jiayu Shen | Yong Xu | Chaoyun Zhang | Yuzhong Qu
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Employing Large Language Models (LLMs) for semantic parsing has achieved remarkable success. However, we find existing methods fall short in terms of reliability and efficiency when hallucinations are encountered. In this paper, we address these challenges with a framework called QueryAgent, which solves a question step-by-step and performs stepwise self-correction. We introduce an environmental feedback-based self-correction method called ERASER. Unlike traditional approaches, ERASER leverages rich environmental feedback in the intermediate steps to perform selective and differentiated self-correction only when necessary. Experimental results demonstrate that QueryAgent notably outperforms all previous few-shot methods using only one example on GrailQA and GraphQ by 5.7 and 15.0 points. Furthermore, our approach exhibits superiority in terms of efficiency, including run-time, query overhead, and API invocation costs. By leveraging ERASER, we further improve another baseline (i.e., AgentBench) by approximately 10 points, validating the strong transferability of our approach.
Search
Fix author
Co-authors
- Qingwei Lin 7
- Dongmei Zhang 7
- Si Qin 5
- Yu Kang 3
- Minghua Ma 3
- Bo Qiao 3
- Saravan Rajmohan 3
- Saravan Rajmohan 3
- Lu Wang 3
- Yong Xu 3
- Sitao Cheng 2
- Shilin He 2
- Xiang Huang 2
- Liqun Li 2
- Qianhui Wu 2
- Qi Zhang 2
- Chetan Bansal 1
- Ling Chen 1
- Yingnong Dang 1
- Ruomeng Ding 1
- Fazle Elahi Faisal 1
- Jianfeng Gao 1
- Shanshan Huang 1
- Yufan Huang 1
- Bowen Li 1
- Mengqi Liao 1
- Xiaojun Ma 1
- Kartik Mathur 1
- Jian Mu 1
- Elsie Nallipogu 1
- Suman Nath 1
- Chiming Ni 1
- Baolin Peng 1
- Xiaoting Qin 1
- Yuzhong Qu 1
- Saravan Rajmohan 1
- Jiayu Shen 1
- Huaiyu Wan 1
- Junhao Wang 1
- Maoquan Wang 1
- Zhaoyang Wang 1
- Jiaheng Wen 1
- Chengxing Xie 1
- Yuhang Xie 1
- Fangkai Yang 1
- Huaxiu Yao 1
- Wenlin Yao 1
- Linghao Zhang 1
- Qi Zhang 1
- Wei Zhang 1
- Xu Zhang 1
- Xuchao Zhang 1
- Mengyu Zhou 1
- Ziyuan Zhuang 1