Jie Zhang
Author directoryOther people with similar names: Jie Zhang, Jie Zhang, Jie Zhang, Jie Zhang, Jie Zhang, Jie Zhang, Jie Zhang, Jie Zhang
Unverified author pages with similar names: Jie Zhang
2026
CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models
Zhenhong Zhou | Zherui Li | Jie Zhang | Yuanhe Zhang | Kun Wang | Yang Liu | Qing Guo
Findings of the Association for Computational Linguistics: ACL 2026
Zhenhong Zhou | Zherui Li | Jie Zhang | Yuanhe Zhang | Kun Wang | Yang Liu | Qing Guo
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Model-based Multi-Agent Systems represent a promising paradigm for tackling complex problems through agent collaboration. However, the reliance on open-ended communication exposes a fundamental vulnerability: the collaborative process itself can be exploited and disrupted. In this work, we formalize this threat class as Denial-of-Collaboration (DoC). Unlike DoS, which targets individual nodes or services, DoC attacks corrupt the collaborative structure of the system, transforming its communication topology into self-sabotage. The result is excessive resource consumption and eventual system paralysis. We introduce COntagious Recursive Blocking Attacks (CORBA) as a concrete example of DoC, which employs benign yet recursively contagious instructions, forcing LLM-MASs into cycles of meaningless message passing. Critically, since our attacks are semantically benign, they easily bypass conventional safety alignments that are not designed to detect behavioral or systemic attacks. Through extensive experiments across diverse topologies and models, we demonstrate that CORBA achieves system paralysis where the baseline attacks fail. Our work reveals emerging DoC threats in current LLM-MAS security and establishes a crucial baseline for developing robust, collaboration-aware defense mechanisms.
INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment
Yutong Zhang | Jianshuo Dong | Peng Xu | Long Wang | Jie Zhang | Tianwei Zhang | Xiaoping Zhang | Han Qiu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yutong Zhang | Jianshuo Dong | Peng Xu | Long Wang | Jie Zhang | Tianwei Zhang | Xiaoping Zhang | Han Qiu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
As large language models (LLMs) are deployed as autonomous agents, safety failures increasingly involve consequential actions. We study agentic misalignment, where agents take harmful actions under goal conflicts and pressures. Using chain-of-thought (CoT) monitoring, we find that harmful execution is often preceded by intent signals in reasoning. However, post-hoc CoT labels are too coarse to show how intent changes during generation. We introduce INTENT-AS-A-TOOL, an approach that adds intent-targeted tools to give the model a dedicated channel for expressing commitment to a target behavior. The probability of calling an intent tool provides a judge-free, fine-grained signal of the model’s tendency to pursue that behavior. Our results show that INTENT-AS-A-TOOL complements CoT monitoring, expands post-hoc CoT labels into dense trajectories, and identifies critical steps for online intervention. These findings suggest that action preferences are useful for tracking agentic misalignment during reasoning. Our code and data are accessible: https://github.com/RebeccaZhang22/intent-as-a-tool.
The Persona-Switch Jailbreak Backdoor in LLMs: From Payload Retrieval to Trigger-Gated Persona-State Selection
Yanghao Su | Wenbo Zhou | Tianwei Zhang | Han Qiu | Weiming Zhang | Nenghai Yu | Jie Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yanghao Su | Wenbo Zhou | Tianwei Zhang | Han Qiu | Weiming Zhang | Nenghai Yu | Jie Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jailbreak backdoors typically pair a trigger with non-refusing responses, but under capability-based evaluation such payload-retrieval attacks often suppress refusal without producing actionable harm. We propose the persona-switch backdoor, where the trigger selects a persona-conditioned behavioral state rather than retrieving a fixed harmful response: style-consistent fine-tuning installs a persona, trigger training converts it into a dormant, trigger-addressable state, and persona-aligned framing amplifies harmful generation after activation. Across two model families and three personas, our attack substantially outperforms payload-retrieval baselines under capability-based evaluation while preserving high refusal rates on non-triggered inputs. The effect holds even for personas whose fine-tuning data contain no explicit harmful instructions, although they encode misaligned dispositions. Applying the same framing to clean and untriggered backdoored models yields near-zero harmful generation, showing that framing alone does not account for the attack and that harm depends on trigger activation of the poisoned persona-conditioned state. Activation steering supports a causal role for the persona-associated direction, pointing to representation-level intervention as a defense.
Auditing Chinese Web-scale Corpora via Sampled BPE Token Statistics
Qingjie Zhang | Ziqi Tang | Jie Zhang | Gelei Deng | Jinfeng Li | YueFeng Chen | Yitong Yang | Hui Xue | Tianwei Zhang | Han Qiu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Qingjie Zhang | Ziqi Tang | Jie Zhang | Gelei Deng | Jinfeng Li | YueFeng Chen | Yitong Yang | Hui Xue | Tianwei Zhang | Han Qiu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Chinese web pollution has surfaced in LLMs, motivating audits of upstream Chinese corpora. However, auditing such corpora faces three challenges: (1) their web-scale size makes full scan costly; (2) prior analyses are often too coarse to expose token-level pollution; (3) Chinese web pollution is implicit and rapidly changing. We propose Sampled-BPE, a lightweight token-level auditing pipeline that sample a small subset and train BPE tokenizer to surface polluted tokens. Experiments show that Sampled-BPE preserves usable estimates while substantially reducing runtime and memory: a 148.4 × speedup and a 35.8 × memory reduction induce only 4.25% relative error for pollution categories. We apply the pipeline to 11 open Chinese corpora and 6 Chinese Common Crawl snapshots from 2021 to 2026. The audit reveals widespread but uneven pollution across open corpora, as well as highly polluted and temporally shifting Chinese web content. We further release a hierarchical Chinese web token dataset with 660k+ token records, each with web context, category, and explanation fields, organized as trees to support review and tracing of pollution.
2025
On the Vulnerability of Text Sanitization
Meng Tong | Kejiang Chen | Xiaojian Yuan | Jiayang Liu | Weiming Zhang | Nenghai Yu | Jie Zhang
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Meng Tong | Kejiang Chen | Xiaojian Yuan | Jiayang Liu | Weiming Zhang | Nenghai Yu | Jie Zhang
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Text sanitization, which employs differential privacy to replace sensitive tokens with new ones, represents a significant technique for privacy protection. Typically, its performance in preserving privacy is evaluated by measuring the attack success rate (ASR) of reconstruction attacks, where attackers attempt to recover the original tokens from the sanitized ones. However, current reconstruction attacks on text sanitization are developed empirically, making it challenging to accurately assess the effectiveness of sanitization. In this paper, we aim to provide a more accurate evaluation of sanitization effectiveness. Inspired by the works of Palamidessi et al., we implement theoretically optimal reconstruction attacks targeting text sanitization. We derive their bounds on ASR as benchmarks for evaluating sanitization performance. For real-world applications, we propose two practical reconstruction attacks based on these theoretical findings. Our experimental results underscore the necessity of reassessing these overlooked risks. Notably, one of our attacks achieves a 46.4% improvement in ASR over the state-of-the-art baseline, with a privacy budget of 𝜖=4.0 on the SST-2 dataset. Our code is available at: https://github.com/mengtong0110/On-the-Vulnerability-of-Text-Sanitization.