The Hallucination Signal Is a Mean Shift: Why Simple Probes Suffice

Jungseob Lee, Jaehyung Seo, Heuiseok Lim


Abstract
Hidden-state probes effectively detect LLM hallucinations, but the geometry of the signal remains poorly characterized, driving increasingly complex probe architectures. Across three 7B-scale models and three datasets in a paired-example paradigm, we find the signal overwhelmingly dominated by a single mean-shift component, and removing this direction collapses detection to chance. Shrinkage linear discriminant analysis closes about 73% of the gap between 1D and full-dimensional classifiers, so apparent architectural complexity largely reflects high-dimensional covariance estimation difficulty rather than exploitable non-linearity. A simple L2-regularized logistic regression (0.952 AUROC) bounds or outperforms twelve controlled architectural alternatives, and our multi-layer aggregation exceeds CLAP cross-layer attention probing under matched paradigm. Because the signal spans a contiguous layer band, LayerMix aggregates it to match oracle-layer performance without oracle access. Our claims characterize the geometry within the controlled paired-example paradigm. Our code is available at https://github.com/js-lee-AI/LayerMix.
Anthology ID:
2026.emnlp-main.1626
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36986–37004
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1626/
DOI:
Bibkey:
Cite (ACL):
Jungseob Lee, Jaehyung Seo, and Heuiseok Lim. 2026. The Hallucination Signal Is a Mean Shift: Why Simple Probes Suffice. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 36986–37004, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The Hallucination Signal Is a Mean Shift: Why Simple Probes Suffice (Lee et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1626.pdf