AdapTools: Adaptive Tool-based Indirect Prompt Injection Attacks on Agentic LLMs

Che Wang, Jiaming Zhang, Ziqi Zhang, Zijie Wang, Yinggui Wang, Jianbo Gao, Tao Wei, Zhong Chen, Wei Yang Bryan Lim


Abstract
As open-source large language models (LLMs) become increasingly powerful, they are rapidly evolving into Agentic LLMs capable of automating complex daily tasks. However, this paradigm shift entails severe security risks, as the agents’ necessary integration with external real-time data sources creates a direct pathway for indirect prompt injection (IPI) attacks. Existing attack methods are limited by their reliance on static patterns and evaluation on simple language models, failing to address the fast-evolving nature of modern Agentic LLMs. We introduce AdapTools, a novel adaptive IPI attack framework that selects stealthier attack tools and generates adaptive attack prompts to create a rigorous security evaluation environment. Our approach comprises two key components: (1) Adaptive Attack Strategy Construction, which develops transferable adversarial strategies for prompt optimization, and (2) Attack Enhancement, which identifies stealthy tools capable of circumventing task-relevance defenses. Comprehensive experiments on both open-source and commercial agentic LLMs show that AdapTools achieves a per-model average improvement of 2.08× in attack success rate over the strongest baseline under state-of-the-art defenses (MELON, Pi-Detector), with gains reaching up to 3.06× on the most resistant reasoning agents. The framework further transfers to black-box commercial agents (GPT, Qwen, Gemini), with ASR ranging from 4.2 to 20.3 (peak on the in-family Qwen-MAX), exposing systematic vulnerabilities in modern Agentic LLMs.
Anthology ID:
2026.emnlp-main.2055
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
46795–46816
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2055/
DOI:
Bibkey:
Cite (ACL):
Che Wang, Jiaming Zhang, Ziqi Zhang, Zijie Wang, Yinggui Wang, Jianbo Gao, Tao Wei, Zhong Chen, and Wei Yang Bryan Lim. 2026. AdapTools: Adaptive Tool-based Indirect Prompt Injection Attacks on Agentic LLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 46795–46816, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AdapTools: Adaptive Tool-based Indirect Prompt Injection Attacks on Agentic LLMs (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2055.pdf