Caicai Guo
Author directory2026
StateSwap: Probing Support–Elimination Hidden States in Multiple-Choice Questions
Chao Gao | Haijiang Liu | Qiyuan Li | Caicai Guo | Frank van Harmelen | Jinguang Gu
Findings of the Association for Computational Linguistics: EMNLP 2026
Chao Gao | Haijiang Liu | Qiyuan Li | Caicai Guo | Frank van Harmelen | Jinguang Gu
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models often answer the same multiple-choice question inconsistently when it is posed under support-oriented and elimination-oriented framings. We investigate whether these discrepancies arise from different internal representations induced by the two framings. We introduce a dual-framing protocol with minimally varied prompts that use either support- or elimination-oriented framing while keeping the evaluation target fixed. To probe the internal computation, we append an untrained special token, [STATE], and treat its residual-stream activation as an intervention interface. Across both models, the two framings induce separable [STATE] activations concentrated in intermediate layers. Swapping these activations between paired prompts systematically changes predictions and improves cross-framing agreement, providing intervention-based evidence that the activations are behaviorally relevant. Beyond instance-level substitution, mean-difference steering directions derived from the dual-framing contrast exhibit more bounded layer-wise responses than matched contrastive activation addition directions under the evaluated protocol.