A Wolf in Sheep’s Clothing: Targeted Routing Hijacking in Federated RAG

Junjie Mu, Qiongxiu Li


Abstract
Federated Retrieval-Augmented Generation (FedRAG) is attractive for privacy-sensitive applications because full local corpora remain on clients. As a result, routing must rely on client-provided semantic profiles, creating a new opportunity for manipulation. We introduce Routing Hijacking, a routing-stage attack in which a malicious client forges its profile to attract target queries despite having irrelevant underlying data. We show that this vulnerability is severe. Across three representative FedRAG routing architectures, Routing Hijacking consistently misroutes target queries and leads to downstream disruptions and failures, including missing evidence, poisoning, incorrect answers, and hallucinations. In a controlled MedQA-USMLE stress test, we further show that poisoned retrieved evidence can mislead models across scales, leading to incorrect answers, hallucinations, and sycophantic failures. Existing defenses do not close this gap: encrypted routing preserves the exploited ranking, and Byzantine-robust Federated Learning (FL) rules transfer poorly to heterogeneous routing profiles. To address this gap, we propose a trust-aware post-routing framework that reweights clients using returned-evidence feedback, including retrieval relevance, profile consistency, and cross-client agreement; online experiments show that it suppresses persistent hijacking over recurring queries and transfers to a learned neural router. Our findings establish routing integrity as a security challenge in FedRAG and highlight the need for stronger defenses for secure federated retrieval.
Anthology ID:
2026.emnlp-main.668
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15388–15411
Language:
URL:
https://aclanthology.org/2026.emnlp-main.668/
DOI:
Bibkey:
Cite (ACL):
Junjie Mu and Qiongxiu Li. 2026. A Wolf in Sheep’s Clothing: Targeted Routing Hijacking in Federated RAG. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 15388–15411, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Wolf in Sheep’s Clothing: Targeted Routing Hijacking in Federated RAG (Mu & Li, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.668.pdf