Yuehao Tang
Author directory2026
LLM Abstention Can Be a Prompt Artifact, in Addition to Genuine Uncertainty
Zipeng Ling | Shuliang Liu | Yuehao Tang | Junqi Yang | Shenghong Fu | Seonil Son | Chen Huang | Kejia Huang | Yao Wan | Zhichao Hou | Xuming Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zipeng Ling | Shuliang Liu | Yuehao Tang | Junqi Yang | Shenghong Fu | Seonil Son | Chen Huang | Kejia Huang | Yao Wan | Zhichao Hou | Xuming Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) are increasingly trained to abstain from answering questions they are unsure about. However, this ability is often misused: in real-world applications, input prompts sometimes contain uncertainty elements, and driven by this, LLMs are inclined to abstain even on problems they are capable of solving. We argue that LLM abstention is not only an expression of genuine uncertainty; it is also an artifact that can be largely influenced by prompts. We name this phenomenon *Abstention Inflation*. We add "Unknown" as an extra option for LLMs to choose from; experiments show serious accuracy drops on True/False Questions (TFQs). Replacing "Unknown" with an unrelated random word produces an identical effect. We argue that LLMs are trained to imitate the surface pattern of abstention, rather than to express genuine uncertainty. Based on ten experiments, we support four claims that form a progressive argument: **(C1)** *Abstention Inflation* is triggered by the structural presence of an extra option, not by genuine uncertainty; **(C2)** further, it makes the model deny it can answer even when it can; **(C3)** at the representation level, this manifests as a later-layer output override; **(C4)** finally, this bias is stable and emerges through instruction tuning, rather than stochastic noise.
Correct Prediction, Wrong Steps? Consensus Reasoning Knowledge Graph for Robust Chain-of-Thought Synthesis
Zipeng Ling | Shuliang Liu | Seonil Son | Shenghong Fu | Yuehao Tang | Yao Wan | Xuming Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zipeng Ling | Shuliang Liu | Seonil Son | Shenghong Fu | Yuehao Tang | Yao Wan | Xuming Hu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have become increasingly used for various tasks, often coupled with chain-of-thought (CoT) prompting to boost accuracy. Recent work has shown that high label-prediction accuracy does not guarantee correct intermediate reasoning, and the causes of *reasoning flaws* vary from sample to sample, yet existing remedies either focus on a single domain or assume that one flaw type applies uniformly across samples. A simple mitigation method is to provide the model with the correct answer, but we show that this yields no consistent improvement in reasoning quality. This indicates that the problem cannot be fixed by LLMs’ awareness of answers, and must instead be addressed through the structure of reasoning. Motivated by this, we propose **CRAFT** (Consensus Reasoning-knowledge-graph Aggregation for Flaw-aware Trace synthesis), which aggregates the consensus components shared across multiple candidate reasoning traces to synthesize improved ones. **CRAFT** consistently improves label-prediction accuracy on both logical and mathematical reasoning benchmarks, outperforming most baselines, while its post-processed traces achieve higher quality under fine-grained benchmark evaluation.