Chong Zhang
Author directoryOther people with similar names: Chong Zhang, Chong Zhang
Unverified author pages with similar names: Chong Zhang
2026
Adversarial Prompt Distillation: Efficient Jailbreak Attacks from Large to Small Language Models
Xiang Li | Chong Zhang | Jia Wang | Fangyu Wu | Yushi Li | Xiaobo Jin
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Xiang Li | Chong Zhang | Jia Wang | Fangyu Wu | Yushi Li | Xiaobo Jin
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Current jailbreak attacks on large language models (LLMs) predominantly rely on LLMs themselves to generate adversarial prompts, creating a critical efficiency bottleneck: each attack requires substantial computational resources and API queries, limiting scalability and practical deployment. To overcome this limitation, we propose Adversarial Prompt Distillation (APD), a novel framework that transfers jailbreaking capabilities from LLMs to small language models (SLMs) for efficient, low-resource attacks. APD integrates three key components: (1) masked adversarial knowledge pre-training via LoRA fine-tuning, (2) dynamic temperature-controlled knowledge distillation to bridge architectural gaps, and (3) reinforcement learning-based template optimization for adaptive refinement. Extensive experiments across 12 models show that APD achieves state-of-the-art attack success rates (e.g., 96.4% ASRk on GPT-4) while dramatically improving efficiency—generating prompts 3.7× faster with 11.3× fewer parameters than teacher models. Our work establishes the first practical framework for lightweight jailbreak attacks, exposes new vulnerabilities in LLM defenses, and provides a scalable testbed for advancing AI safety research. Our code is available at: https://github.com/lxgem/Efficient_and_Stealthy_Jailbreak_Attacks_via_Adversarial_Prompt.
Can Persona-Conditioned Language Agents Simulate Counterfactual Online Discourse Dynamics?
Zhixiang Lu | Botao Zheng | Xueyuan Deng | Chong Zhang | Peiyu Hu | Mian Zhou | Jionglong Su
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhixiang Lu | Botao Zheng | Xueyuan Deng | Chong Zhang | Peiyu Hu | Mian Zhou | Jionglong Su
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Language agents are increasingly used as social simulators, but most are evaluated by local utterance plausibility rather than their ability to reproduce longitudinal discourse dynamics. We introduce PRISM, a calibrated language-agent framework for forecasting and counterfactual simulation of social media threads. PRISM separates three components that are often conflated in prompt-only agents: latent affective evolution, participation control, and language generation. It models affect with a profile-conditioned stochastic differential equation, selects participation through a partially observed activation policy, and uses a language model as a controlled generator conditioned on the resulting state. Agent profiles are instantiated with MBTI-like anchors, but treated only as behavioral priors rather than psychological ground truth. On 47,207 post-rooted discussion threads spanning 159 trending topics and 356,593 hierarchical comments, PRISM outperforms homogeneous, random, continuous-trait, prompt-only, and memory-only baselines in trajectory alignment, held-out thread forecasting, and blind human evaluation. Reliability analysis further validates LLM-derived weak labels against human and independent-model annotations. These results suggest that calibrated state-space agents offer a more reliable foundation for online discourse simulation than persona prompting alone.
2025
Invisible Prompts, Visible Threats: Malicious Font Injection in External Resources for Large Language Models
Junjie Xiong | Changjia Zhu | Shuhang Lin | Chong Zhang | Yongfeng Zhang | Yao Liu | Lingyao Li
Findings of the Association for Computational Linguistics: EMNLP 2025
Junjie Xiong | Changjia Zhu | Shuhang Lin | Chong Zhang | Yongfeng Zhang | Yao Liu | Lingyao Li
Findings of the Association for Computational Linguistics: EMNLP 2025
Large Language Models (LLMs) are increasingly equipped with capabilities of real-time web search and integrated with protocols like the Model Context Protocol (MCP). This extension could introduce new security vulnerabilities. We present a systematic investigation of LLM vulnerabilities to hidden adversarial prompts through malicious font injection in external resources like webpages, where attackers manipulate code-to-glyph mapping to inject deceptive content which are invisible to users. We evaluate two critical attack scenarios: (1) malicious content relay and (2) sensitive data leakage through MCP-enabled tools. Our experiments reveal that indirect prompts with injected malicious font can bypass LLM safety mechanisms through external resources, achieving varying success rates based on data sensitivity and prompt design. Our research underscores the urgent need for enhanced security measures in LLM deployments when processing external content.
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation
Haochen Xue | Feilong Tang | Ming Hu | Yexin Liu | Qidong Huang | Yulong Li | Chengzhi Liu | Zhongxing Xu | Chong Zhang | Chun-Mei Feng | Yutong Xie | Imran Razzak | Zongyuan Ge | Jionglong Su | Junjun He | Yu Qiao
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Haochen Xue | Feilong Tang | Ming Hu | Yexin Liu | Qidong Huang | Yulong Li | Chengzhi Liu | Zhongxing Xu | Chong Zhang | Chun-Mei Feng | Yutong Xie | Imran Razzak | Zongyuan Ge | Jionglong Su | Junjun He | Yu Qiao
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Recent multimodal large language models (MLLMs) have demonstrated significant potential in open-ended conversation, generating more accurate and personalized responses. However, their abilities to memorize, recall, and reason in sustained interactions within real-world scenarios remain underexplored. This paper introduces MMRC, a Multi-Modal Real-world Conversation benchmark for evaluating six core open-ended abilities of MLLMs: information extraction, multi-turn reasoning, information update, image management, memory recall, and answer refusal. With data collected from real-world scenarios, MMRC comprises 5,120 conversations and 28,720 corresponding manually labeled questions, posing a significant challenge to existing MLLMs. Evaluations on 20 MLLMs in MMRC indicate an accuracy drop during open-ended interactions. We identify four common failure patterns: long-term memory degradation, inadequacies in updating factual knowledge, accumulated assumption of error propagation, and reluctance to “say no.” To mitigate these issues, we propose a simple yet effective NOTE-TAKING strategy, which can record key information from the conversation and remind the model during its responses, enhancing conversational capabilities. Experiments across six MLLMs demonstrate significant performance improvements.
Search
Fix author
Co-authors
- Jionglong Su 2
- Xueyuan Deng 1
- Chun-Mei Feng 1
- Zongyuan Ge 1
- Junjun He 1
- Ming Hu 1
- Peiyu Hu 1
- Qidong Huang 1
- Xiaobo Jin 1
- Lingyao Li 1
- Xiang Li 1
- Yulong Li 1
- Yushi Li 1
- Shuhang Lin 1
- Chengzhi Liu 1
- Yao Liu 1
- Yexin Liu 1
- Zhixiang Lu 1
- Yu Qiao 1
- Imran Razzak 1
- Feilong Tang 1
- Jia Wang 1
- Fangyu Wu 1
- Yutong Xie 1
- Junjie Xiong 1
- Zhongxing Xu 1
- Haochen Xue 1
- Yongfeng Zhang 1
- Botao Zheng 1
- Mian Zhou 1
- Changjia Zhu 1