STAR: Detecting Inference-time Backdoors in LLM Reasoning via Prior-Posterior Amplification

Seong-Gyu Park, Sohee Park, Jisu Lee, Hyunsik Na, Daeseon Choi


Abstract
Recent LLMs increasingly rely on explicit reasoning mechanisms such as Chain-of-Thought, but these reasoning traces also create a new attack surface for inference-time backdoors that steer the model toward malicious reasoning paths without modifying its parameters. Such attacks can remain linguistically coherent, making them difficult to detect with surface-, consistency-, or confidence-based signals. We propose STAR, a lightweight detection framework that compares input-conditioned token probabilities with prior-only reasoning probabilities. STAR measures token-level prior-posterior amplification and applies CUSUM to identify persistent anomalies in the generated reasoning process. Experiments across four LLMs (8B-70B), five reasoning benchmarks, and three inference-time backdoor attacks show that STAR achieves strong detection performance, with an average AUROC of 0.980, and substantially lower TFLOPs than high-overhead baselines such as Onion. STAR also remains effective under top-k logit access and the evaluated burn-in-aware adaptive attacks, while exposing a trade-off between evasion attempts and attack success.
Anthology ID:
2026.findings-emnlp.2010
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
42780–42797
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2010/
DOI:
Bibkey:
Cite (ACL):
Seong-Gyu Park, Sohee Park, Jisu Lee, Hyunsik Na, and Daeseon Choi. 2026. STAR: Detecting Inference-time Backdoors in LLM Reasoning via Prior-Posterior Amplification. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 42780–42797, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
STAR: Detecting Inference-time Backdoors in LLM Reasoning via Prior-Posterior Amplification (Park et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2010.pdf