CONSPIR ED: A Dataset for Cognitive Traits of Conspiracy Theories and Large Language Model Safety

Luke Bates, Max Glockner, Preslav Nakov, Iryna Gurevych


Abstract
Conspiracy theories erode public trust in science and institutions while resisting debunking by evolving and absorbing counter-evidence. As AI-generated misinformation becomes increasingly sophisticated, understanding the rhetorical patterns in conspiratorial content is important for developing interventions such as targeted prebunking and assessing AI vulnerabilities. We introduce CONSPIRED (CONSPIR Evaluation Dataset), which captures the cognitive traits of conspiratorial ideation in multi-sentence excerpts (80–120 words) from online conspiracy articles, annotated using the CONSPIR cognitive framework. CONSPIRED is the first dataset of conspiratorial content annotated for general cognitive traits. Using CONSPIRED, we (i) develop computational models that identify conspiratorial traits and the dominant trait in text excerpts, and (ii) evaluate LLM robustness to conspiratorial inputs. We find that LLMs are readily misaligned by conspiratorial framing, reproducing its rhetorical patterns even when successfully deflecting comparable fact-checked misinformation.1
Anthology ID:
2026.tacl-1.96
Volume:
Transactions of the Association for Computational Linguistics, Volume 14
Month:
Year:
2026
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
2120–2144
Language:
URL:
https://aclanthology.org/2026.tacl-1.96/
DOI:
10.1162/tacl.a.794
Bibkey:
Cite (ACL):
Luke Bates, Max Glockner, Preslav Nakov, and Iryna Gurevych. 2026. CONSPIR ED: A Dataset for Cognitive Traits of Conspiracy Theories and Large Language Model Safety. Transactions of the Association for Computational Linguistics, 14:2120–2144.
Cite (Informal):
CONSPIR ED: A Dataset for Cognitive Traits of Conspiracy Theories and Large Language Model Safety (Bates et al., TACL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.tacl-1.96.pdf