Jiyang Qiu
Author directory2026
Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustness
Jiyang Qiu | Xinbei Ma | Yunqing Xu | Zhuosheng Zhang | Hai Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiyang Qiu | Xinbei Ma | Yunqing Xu | Zhuosheng Zhang | Hai Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
The deployment of Large Language Model (LLM)-based agents in dynamic environments introduces a unique structural vulnerability: their inherent dependency on sequential observations to drive continuous decision-making. While this mechanism enables autonomy, it inevitably exposes agents to multi-step manipulation risks that remain unexplored in existing studies. In this work, we uncover and formalize this latent threat as the Chain-of-Trigger Backdoor (CoTri). Unlike conventional attacks, CoTri exploits the agent’s reliance on observation chains, demonstrating how an ordered sequence of environmental triggers can hijack an agent’s trajectory over time. Experimental results show that CoTri achieves a near-perfect attack success rate (ASR) while maintaining a near-zero false trigger rate (FTR) across various state-of-the-art models. Due to training data modeling the stochastic nature of the environment, the implantation of CoTri paradoxically enhances the agent’s performance on benign tasks and even improves its robustness against environmental distractions. We further validate CoTri on vision-language models (VLMs), confirming its scalability to multimodal agents. Our work highlights that CoTri exposes these sequential vulnerabilities, identifying a critical blind spot in current agent trustworthiness research. The code is available at [https://github.com/MonoQ-hub/Cotri](https://github.com/MonoQ-hub/Cotri).
Communication Policy Evolution for Proactive LLM Agents
Xinbei Ma | Jiyang Qiu | Yao Yao | Zheng Wu | Yijie Lu | Xiangmou Qu | Jiaxin Yin | Xingyu Lou | Jun Wang | Weiwen Liu | Weinan Zhang | Zhuosheng Zhang | Hai Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xinbei Ma | Jiyang Qiu | Yao Yao | Zheng Wu | Yijie Lu | Xiangmou Qu | Jiaxin Yin | Xingyu Lou | Jun Wang | Weiwen Liu | Weinan Zhang | Zhuosheng Zhang | Hai Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
LLM agents have rapidly evolved into autonomous systems, yet a persistent information gap remains between users and agents: communication is costly, while users’ identical preferences further limit information exchange. To investigate how agents should communicate across modalities, this paper formalizes Communication Policy, establishes textual and UI-based policies, and then evaluates communication policies across diverse environments, personas, and model combinations. Building on information asymmetry for proactive agents, we set up two complementary settings, User–Agent and Planner–Executor. Experimental results reveal complementary strengths between interaction channels: text-based interaction often facilitates task performance, while structured UI improves agents’ response quality and persona compliance. Motivated by that, a hybrid method that combines these advantages, we further propose Communication Policy Evolution (CPE), a self-evolution framework for refining communication policies through rollout and prompt-level evolution. Without model modification, CPE achieves the best task success across multiple settings using prompt refinement alone. Our findings identify communication behavior as a critical yet underexplored design dimension for LLM agents.
2025
MEGen: Generative Backdoor into Large Language Models via Model Editing
Jiyang Qiu | Xinbei Ma | Zhuosheng Zhang | Hai Zhao | Yun Li | Qianren Wang
Findings of the Association for Computational Linguistics: ACL 2025
Jiyang Qiu | Xinbei Ma | Zhuosheng Zhang | Hai Zhao | Yun Li | Qianren Wang
Findings of the Association for Computational Linguistics: ACL 2025
Large language models (LLMs) have exhibited remarkable versatility and adaptability, while their widespread adoption across various applications also raises critical safety concerns.This paper focuses on the impact of backdoored LLMs. Traditional backdoor injection methods are primarily limited to yes-or-no discriminative tasks, leading users to underestimate the potential risks of backdoored LLMs.Given the inherently generative nature of LLMs, this paper reveals that a generative backdoor injected into LLMs can expose the true safety risks in their applications. We propose an editing-based generative backdoor, named MEGen, aiming to expand the backdoor to generative tasks in a unified format of any text-to any text, leading to natural generations with a specific intention. Experiments show that MEGen achieves a high attack success rate by adjusting only a small set of local parameters with few-shot samples. Notably, we show that the backdoored model, when triggered, can freely output pre-set dangerous information while completing downstream tasks.Our work highlights that MEGen enables backdoors in LLMs to exhibit generative capabilities, causing potential safety risks by altering the generative style. The code is available at https://github.com/MonoQ-hub/MEGen.
2024
On the Robustness of Editing Large Language Models
Xinbei Ma | Tianjie Ju | Jiyang Qiu | Zhuosheng Zhang | Hai Zhao | Lifeng Liu | Yulong Wang
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Xinbei Ma | Tianjie Ju | Jiyang Qiu | Zhuosheng Zhang | Hai Zhao | Lifeng Liu | Yulong Wang
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have played a pivotal role in building communicative AI, yet they encounter the challenge of efficient updates. Model editing enables the manipulation of specific knowledge memories and the behavior of language generation without retraining. However, the robustness of model editing remains an open question. This work seeks to understand the strengths and limitations of editing methods, facilitating practical applications of communicative AI. We focus on three key research questions. RQ1: Can edited LLMs behave consistently resembling communicative AI in realistic situations? RQ2: To what extent does the rephrasing of prompts lead LLMs to deviate from the edited knowledge memory? RQ3: Which knowledge features are correlated with the performance and robustness of editing? Our empirical studies uncover a substantial disparity between existing editing methods and the practical application of LLMs. On rephrased prompts that are flexible but common in realistic applications, the performance of editing experiences a significant decline. Further analysis shows that more popular knowledge is memorized better, easier to recall, and more challenging to edit effectively.