The Trigger Is in the Embedding: Supervision-Free Discovery and Diagnosis of Universal Adversarial Triggers in Fact Verification

Michele Luca Contalbo, Matteo Paganelli, Paolo Papotti, Francesco Guerra


Abstract
Despite their widespread adoption, the robustness of fact-checking models to adversarial perturbations remains underexplored. Existing approaches are model-specific and require gradient access or dataset-dependent optimization, with implications for generalization, efficiency, and semantic validity. We introduce FactFlip, a framework for analyzing robustness in claim verification models via universal adversarial triggers. FactFlip identifies perturbative trigger words through a lightweight, model-only procedure that ranks candidates by the alignment of their non-contextualized embeddings with class-specific decision directions, without labeled data or gradient access. Trigger discovery is decoupled from claim perturbation via an LLM-based perturb-and-verify pipeline that preserves semantic validity. Experiments show that FactFlip discriminates between strong and weak triggers, composes them constructively, and rivals fully supervised gradient-based baselines. We further show that FactFlip doubles as a diagnostic lens, surfacing socially salient model biases without any task-specific supervision.
Anthology ID:
2026.emnlp-main.2376
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
53968–53992
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2376/
DOI:
Bibkey:
Cite (ACL):
Michele Luca Contalbo, Matteo Paganelli, Paolo Papotti, and Francesco Guerra. 2026. The Trigger Is in the Embedding: Supervision-Free Discovery and Diagnosis of Universal Adversarial Triggers in Fact Verification. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 53968–53992, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The Trigger Is in the Embedding: Supervision-Free Discovery and Diagnosis of Universal Adversarial Triggers in Fact Verification (Contalbo et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2376.pdf