Xingyu Lou
Author directory2026
Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learning
Zheng Wu | Xingyu Lou | Xinbei Ma | Yansi Li | Weiwen Liu | Weinan Zhang | Jun Wang | Zhuosheng Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Zheng Wu | Xingyu Lou | Xinbei Ma | Yansi Li | Weiwen Liu | Weinan Zhang | Jun Wang | Zhuosheng Zhang
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Model (LLM)-based agents significantly extend the utility of LLMs by interacting with dynamic environments. However, enabling agents to continually learn new tasks without catastrophic forgetting remains a critical challenge, known as the stability–plasticity dilemma.In this work, we argue that this dilemma fundamentally arises from the failure to explicitly distinguish between common knowledge shared across tasks and conflicting knowledge introduced by task-specific interference. To address this, we propose Agent-Dice, a parameter fusion framework based on directional consensus evaluation.Concretely, Agent-Dice disentangles knowledge updates through a two-stage process: geometric consensus filtering to prune conflicting gradients, and curvature-based importance weighting to amplify shared semantics.We provide a rigorous theoretical analysis that establishes the validity of the proposed fusion scheme and offers insight into the origins of the stability–plasticity dilemma. Extensive experiments on GUI agents and tool-use agent domains demonstrate that Agent-Dice exhibits outstanding continual learning performance with minimal computational overhead and parameter updates.
OSCAR: Optimization-Steered Agentic Planning for Composed Image Retrieval
Teng Wang | Rong Shan | Jianghao Lin | Junjie Wu | Tianyi Xu | Jianping Zhang | Wenteng Chen | Changwang Zhang | Zhaoxiang Wang | Xingyu Lou | Weinan Zhang | Jun Wang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Teng Wang | Rong Shan | Jianghao Lin | Junjie Wu | Tianyi Xu | Jianping Zhang | Wenteng Chen | Changwang Zhang | Zhaoxiang Wang | Xingyu Lou | Weinan Zhang | Jun Wang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Composed image retrieval (CIR) requires complex reasoning over heterogeneous visual and textual constraints. Existing approaches largely fall into two paradigms: unified embedding retrieval, which suffers from single-model myopia, and heuristic agentic retrieval, which is limited by suboptimal, trial-and-error orchestration. To this end, we propose OSCAR, an optimization-steered agentic planning framework for composed image retrieval. We are the first to reformulate agentic CIR from a heuristic search process into a principled trajectory optimization problem. Instead of relying on heuristic trial-and-error exploration, OSCAR employs a novel offline-online paradigm. In the offline phase, we model CIR via atomic retrieval selection and composition as a two-stage mixed-integer programming problem, mathematically deriving optimal trajectories that maximize ground-truth coverage for training samples via rigorous boolean set operations. These trajectories are then stored in a golden library to serve as in-context demonstrations for online steering of VLM planner at online inference time. Extensive experiments on three public benchmarks and a private industrial benchmark show that OSCAR consistently outperforms SOTA baselines. Notably, it achieves superior performance using only 10% of training data, demonstrating strong generalization of planning logic rather than dataset-specific memorization.
Communication Policy Evolution for Proactive LLM Agents
Xinbei Ma | Jiyang Qiu | Yao Yao | Zheng Wu | Yijie Lu | Xiangmou Qu | Jiaxin Yin | Xingyu Lou | Jun Wang | Weiwen Liu | Weinan Zhang | Zhuosheng Zhang | Hai Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xinbei Ma | Jiyang Qiu | Yao Yao | Zheng Wu | Yijie Lu | Xiangmou Qu | Jiaxin Yin | Xingyu Lou | Jun Wang | Weiwen Liu | Weinan Zhang | Zhuosheng Zhang | Hai Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
LLM agents have rapidly evolved into autonomous systems, yet a persistent information gap remains between users and agents: communication is costly, while users’ identical preferences further limit information exchange. To investigate how agents should communicate across modalities, this paper formalizes Communication Policy, establishes textual and UI-based policies, and then evaluates communication policies across diverse environments, personas, and model combinations. Building on information asymmetry for proactive agents, we set up two complementary settings, User–Agent and Planner–Executor. Experimental results reveal complementary strengths between interaction channels: text-based interaction often facilitates task performance, while structured UI improves agents’ response quality and persona compliance. Motivated by that, a hybrid method that combines these advantages, we further propose Communication Policy Evolution (CPE), a self-evolution framework for refining communication policies through rollout and prompt-level evolution. Without model modification, CPE achieves the best task success across multiple settings using prompt refinement alone. Our findings identify communication behavior as a critical yet underexplored design dimension for LLM agents.
ColorBrowserAgent: Complex Long-Horizon Browser Agent with Adaptive Knowledge Evolution
Jihong Wang | Jiamu Zhou | Weiming Zhang | Teng Wang | Weiwen Liu | Zhuosheng Zhang | Xingyu Lou | Weinan Zhang | Huarong Deng | Jun Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Jihong Wang | Jiamu Zhou | Weiming Zhang | Teng Wang | Weiwen Liu | Zhuosheng Zhang | Xingyu Lou | Weinan Zhang | Huarong Deng | Jun Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
With the advancement of vision-language models, web automation has made significant progress. However, deploying autonomous agents in real-world settings remains challenging, primarily due to site heterogeneity, where generalist models lack domain-specific priors for diverse interfaces, and long-horizon instability, characterized by the accumulation of decision drift over extended interactions. To address these challenges, we introduce ColorBrowserAgent (Complex Long-Horizon Browser Agent), a knowledge-evolving agent for robust web automation. Our approach addresses these challenges through two synergistic mechanisms: human-in-the-loop knowledge adaptation that transforms sparse human feedback into reusable domain knowledge, and knowledge-aligned progressive summarization that stabilizes long interactions through memory compression. Extensive experiments on WebArena, WebChoreArena and industrial deployment show that ColorBrowserAgent consistently outperforms strong baselines. It achieves a state-of-the-art success rate of 71.2% on WebArena and maintains 47.4% performance under zero-shot transfer setting on WebChoreArena. In commercial deployment, it improves user satisfaction by 19.3% relatively, verifying its robustness in real-world scenarios.