Bensheng Qiu
Author directory2026
FLOW-ABSTAIN: Modeling the Answerable Manifold for Query-Aware Abstention in Large Language Models
Jixin Zhang | Bensheng Qiu
Findings of the Association for Computational Linguistics: EMNLP 2026
Jixin Zhang | Bensheng Qiu
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) frequently hallucinate when confronted with queries they cannot answer reliably. The root causes are multifaceted, including entity rarity, semantic ambiguity, temporal invalidity, false presuppositions, and other forms of epistemic uncertainty. Existing abstention mechanisms overwhelmingly rely on binary probes trained with manually curated “unanswerable” labels or calibrated confidence scores, both of which presuppose access to negative examples that are expensive to collect and fundamentally incomplete in coverage. We propose FLOW-ABSTAIN, an unsupervised framework that reframes query-aware abstention as density estimation in the model’s own latent space. Our method operates in three stages: (1) extracting intermediate hidden-state representations from a curated set of confidently answerable queries, (2) applying PCA-based dimensionality reduction to obtain a compact manifold, and (3) fitting a Masked Autoregressive Flow (MAF) to the resulting representations, yielding an exact, tractable log-likelihood for arbitrary new inputs. At inference time, queries whose latent projections receive low log-likelihood under the learned density are flagged for abstention—without requiring any negative or out-of-distribution training samples. Experiments across three instruction-tuned LLMs (Qwen-3-8B, Qwen-3-14B, Llama-3-8B-Instruct) and five diverse evaluation benchmarks demonstrate that FLOW-ABSTAIN achieves highly competitive abstention performance among methods with practical inference cost while providing a continuous, interpretable likelihood signal that naturally stratifies query difficulty along cognitive dimensions of unanswerability.