DTS: Discriminant Truthfulness Scoring for Gradient-Free Hallucination Detection

Kaustubh Atey, Shreeyam Bangera, Sandeep Kumar, Ankit Kumar, Amit Sethi


Abstract
Large language models can hallucinate with the same fluent confidence they bring to correct answers, making reliable hallucination detection essential for trustworthy deployment. Existing detectors based on LLM hidden states often rely on cosine or linear readouts that ignore the anisotropic structure of the representation space. We introduce DTS (Discriminant Truthfulness Scoring), a lightweight, gradient-free detector that whitens hidden activations using within-class covariance and scores responses with a closed-form Fisher discriminant. Across Qwen-2.5-7B and Llama-3.1-8B on four QA datasets, DTS ranks first in five of eight settings and second in the remaining three. Whitening improves over cosine scoring by 7.8 AUROC points on average, identifying the readout as a major bottleneck. When truthful and hallucinated representations overlap, class-mean steering provides additional gains without learning a steering vector. DTS requires only a single forward pass and closed-form computation, making it substantially cheaper than sampling- and gradient-based alternatives, while also extending effectively to long-form generation.
Anthology ID:
2026.groundlm-1.52
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
694–711
Language:
URL:
https://aclanthology.org/2026.groundlm-1.52/
DOI:
Bibkey:
Cite (ACL):
Kaustubh Atey, Shreeyam Bangera, Sandeep Kumar, Ankit Kumar, and Amit Sethi. 2026. DTS: Discriminant Truthfulness Scoring for Gradient-Free Hallucination Detection. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 694–711, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DTS: Discriminant Truthfulness Scoring for Gradient-Free Hallucination Detection (Atey et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.52.pdf