Zihao Huang
Author directoryOther people with similar names: Zihao Huang, Zihao Huang
Unverified author pages with similar names: Zihao Huang
2026
Uncovering the Knowledge Boundaries and Mechanistic "Knob" of LLMs
Zihao Huang | Rui Mao | Yong Jiang | Erik Cambria
Findings of the Association for Computational Linguistics: EMNLP 2026
Zihao Huang | Rui Mao | Yong Jiang | Erik Cambria
Findings of the Association for Computational Linguistics: EMNLP 2026
Large Language Models often generate incorrect factual answers, yet it remains unclear how they internally distinguish facts they know from those they do not. Existing hallucination-detection methods largely rely on behavioral signals or opaque scalar scores, leaving the structure of factual knowledge in hidden state space poorly understood. We address this gap by introducing a coarse-to-fine framework to discover a knowledge boundary: a decision surface in transformer hidden states that separates representations leading to correct factual answers from those leading to errors. Across multiple datasets and model families, we show that factual correctness is predictable from hidden states, and that this signal is concentrated in specific layers and a small number of influential dimensions. Using Qwen3-8B as a case study, we further identify a compact "knob" subspace that retains near-full boundary-prediction performance and supports targeted interventions that bidirectionally modulate the likelihood of the full reference answer under teacher forcing.