Adversarial Robustness of Retrieval-Based Fact-Checking: Detecting and Mitigating Evidence Contamination

Alamgir Munir Qazi, John Philip McCrae, Jamal Abdul Nasir


Abstract
Retrieval-based fact-checking systems ground verification in large document collections, creating a critical vulnerability: adversarial evidence contamination. We demonstrate that factually inconsistent but contextually coherent evidence generated to satisfy both retrieval-similarity and linguistic-fluency constraints can systematically mislead verification models. Contaminating just 3.1-7.4% of training corpora with five label-specific strategies causes adversarial content to penetrate up to 35.2% of top-k retrievals, degrading verification accuracy by up to 46.9% relative F1. Existing retrieval-stage defenses, validated against gradient-optimized or syntactically anomalous attacks, transfer poorly to this threat model: detection rates collapse and F1 recovery exhibits high variance across seeds.

We propose GLAD (Geometric-Lexical Adversarial Defense), which fuses dense embedding peer-coherence with lexical distributional isolation. Across two benchmarks, two embedding models, and five random seeds, GLAD achieves the highest detection rates (70-86%) and the most consistent F1 recovery, reclaiming 73-80% of contamination-induced degradation on LIAR-RAW while approaching clean baselines on RAWFC. Crucially, unlike defenses that trade clean performance for robustness, GLAD imposes negligible cost on uncontaminated corpora.
Anthology ID:
2026.findings-emnlp.1701
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36342–36355
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1701/
DOI:
Bibkey:
Cite (ACL):
Alamgir Munir Qazi, John Philip McCrae, and Jamal Abdul Nasir. 2026. Adversarial Robustness of Retrieval-Based Fact-Checking: Detecting and Mitigating Evidence Contamination. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 36342–36355, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Adversarial Robustness of Retrieval-Based Fact-Checking: Detecting and Mitigating Evidence Contamination (Qazi et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1701.pdf