Liuyu Xiang
Author directory2026
Fully Decoupled Reinforcement Learning with Adaptive Data Curation for GUI Agents
Pengxiang Li | Zechenhu | Zirui Shang | Jingrong Wu | Yang Liu | Hui Liu | Zhi Gao | Chenrui Shi | Bofei Zhang | Zihao Zhang | Xiaochuan Shi | Zedong YU | Yuwei Wu | Xinxiao Wu | Yunde Jia | Liuyu Xiang | Zhaofeng He | Qing Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Pengxiang Li | Zechenhu | Zirui Shang | Jingrong Wu | Yang Liu | Hui Liu | Zhi Gao | Chenrui Shi | Bofei Zhang | Zihao Zhang | Xiaochuan Shi | Zedong YU | Yuwei Wu | Xinxiao Wu | Yunde Jia | Liuyu Xiang | Zhaofeng He | Qing Li
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Vision-Language Models (VLMs) have catalyzed the development of Graphical User Interface (GUI) agents for desktop automation. However, reinforcement learning (RL) for GUI agents remains bottlenecked by two challenges: existing RL frameworks still leave substantial idle time inside the rollout stage, and the learning signal from long-horizon, sparse-reward interactions is highly imbalanced. In this paper, we introduce DART, a fully Decoupled Agentic RL Training framework for GUI agents. Whereas prior RL designs only separate the trainer from the rollout, DART splits the pipeline into four independent modules: environment cluster, rollout service, data manager, and trainer, which brings two extra efficiency benefits: rollout-wise trajectory scheduling and per-worker model synchronization. This yields a 1.6× increase in GPU utilization, a 1.9× boost in training throughput, and a 5.5× increase in environment utilization over a non-decoupled baseline. We further propose a multi-level adaptive data curation scheme operating at the task, trajectory, step, and token levels: it reallocates rollout budget by task difficulty, bootstraps hard tasks with a pre-collected experience pool, restricts policy updates to high-entropy critical steps, and applies truncated importance sampling to absorb the distribution gap between th rollout and training engines. On the OSWorld benchmark, our DART-GUI-7B achieves a 42.13 task success rate, a 14.61 absolute improvement over its base model and a new state of the art among open-source 7B-scale agents. Code, data, and model checkpoints are open-sourced at https://dart-gui-anonymous.github.io (anonymous).
CO-EVO: Co-evolving Semantic Anchoring and Style Diversification for Federated DG-ReID
Fengchunzhang | Qiang Ma | Liuyu Xiang | Jinshan Lai | Tingxuan Huang | Jianwei Hu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Fengchunzhang | Qiang Ma | Liuyu Xiang | Jinshan Lai | Tingxuan Huang | Jianwei Hu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Federated domain generalization for person re-identification (FedDG-ReID) aims to collaboratively train a pedestrian retrieval model across multiple decentralized source domains such that it can generalize to unseen target environments without compromising raw data privacy. However, this task is significantly challenged by the inherent stylistic gaps across decentralized clients. Without global supervision, models easily succumb to shortcut learning where representations overfit to domain specific camera biases rather than universal identity features. We propose CO-EVO, a novel federated framework that resolves this semantic-style conflict through a co-evolutionary mechanism. On the semantic side, Camera-Invariant Semantic Anchoring (CSA) learns identity prompts with cross-camera consistency to establish purified and domain-agnostic anchors that filter out local imaging noise. On the visual side, Global Style Diversification (GSD), powered by a Global Camera-Style Bank (GCSB), synthesizes realistic perturbations to expand the visual boundaries of training data. The core of CO-EVO is its co-evolutionary loop where purified anchors act as gravitational centers to guide the image encoder toward robust anatomical attributes amidst diverse style variations. Extensive experiments demonstrate that CO-EVO achieves state-of-the-art (SOTA) performance, proving that the synergy between semantic purification and style expansion is essential for robust cross-domain generalization. Our code is available at: https://github.com/NanYiyuzurn/ACL-LGPS-2026.
2025
Select-Then-Decompose: From Empirical Analysis to Adaptive Selection Strategy for Task Decomposition in Large Language Models
Shuodi Liu | Yingzhuo Liu | Zi Wang | Yusheng Wang | Huijia Wu | Liuyu Xiang | Zhaofeng He
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Shuodi Liu | Yingzhuo Liu | Zi Wang | Yusheng Wang | Huijia Wu | Liuyu Xiang | Zhaofeng He
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have demonstrated remarkable reasoning and planning capabilities, driving extensive research into task decomposition. Existing task decomposition methods focus primarily on memory, tool usage, and feedback mechanisms, achieving notable success in specific domains, but they often overlook the trade-off between performance and cost. In this study, we first conduct a comprehensive investigation on task decomposition, identifying six categorization schemes. Then, we perform an empirical analysis of three factors that influence the performance and cost of task decomposition: categories of approaches, characteristics of tasks, and configuration of decomposition and execution models, uncovering three critical insights and summarizing a set of practical principles. Building on this analysis, we propose the Select-Then-Decompose strategy, which establishes a closed-loop problem-solving process composed of three stages: selection, execution, and verification. This strategy dynamically selects the most suitable decomposition approach based on task characteristics and enhances the reliability of the results through a verification module. Comprehensive evaluations across multiple benchmarks show that the Select-Then-Decompose consistently lies on the Pareto frontier, demonstrating an optimal balance between performance and cost. Our code is publicly available at https://github.com/summervvind/Select-Then-Decompose.
2023
An Adaptive Prompt Generation Framework for Task-oriented Dialogue System
Jun Gao | Liuyu Xiang | Huijia Wu | Han Zhao | Yiqi Tong | Zhaofeng He
Findings of the Association for Computational Linguistics: EMNLP 2023
Jun Gao | Liuyu Xiang | Huijia Wu | Han Zhao | Yiqi Tong | Zhaofeng He
Findings of the Association for Computational Linguistics: EMNLP 2023
The de facto way of utilizing black-box large language models (LLMs) to perform various downstream tasks is prompting. However, obtaining suitable prompts for specific tasks is still a challenging problem. While existing LLM-based methods demonstrate promising performance in task-oriented dialogue (TOD) task, they often require manual adjustment in prompt selection, or focus solely on dialogue understanding or generation. To address these issues, we propose an adaptive prompt generation framework to fully unleash the potential of LLMs for the comprehensive TOD system. Firstly, we design a trainable slot generator (TSG) that can generate domain and slot information in the belief state, which serves as prior knowledge for subsequent prompt generation. Next, we propose an adaptive prompt generator (APG) that utilizes the prior knowledge to generate prompts for the LLM, deriving the belief state and system response of the dialogue for evaluation. Finally, we evaluate our framework on the MultiWOZ 2.0 dataset. Extensive experiments demonstrate that our method outperforms existing methods. Our code and data will be released.
Search
Fix author
Co-authors
- Zhaofeng He 3
- Huijia Wu 2
- Fengchunzhang 1
- Jun Gao 1
- Zhi Gao 1
- Jianwei Hu 1
- Tingxuan Huang 1
- Yunde Jia 1
- Jinshan Lai 1
- Pengxiang Li 1
- Qing Li 1
- Hui Liu 1
- Shuodi Liu 1
- Yang Liu 1
- Yingzhuo Liu 1
- Qiang Ma 1
- Zirui Shang 1
- Chenrui Shi 1
- Xiaochuan Shi 1
- Yiqi Tong (童逸琦) 1
- Yusheng Wang 1
- Zi Wang 1
- Jingrong Wu 1
- Xinxiao Wu 1
- Yuwei Wu 1
- Zedong YU 1
- Zechenhu 1
- Bofei Zhang 1
- Zihao Zhang 1
- Han Zhao 1