Reset Is Not Recovery: Evaluating Recoverability from False Conversational Context via Sycophancy Hysteresis

Adi Shnaidman


Abstract
Grounded language models are usually evaluated by adding relevant context, but multi-turn dialogue also contains unsupported user claims that may contaminate later factual answers. We study post-pressure recoverability: whether a model returns to clean-context behavior after a user repeatedly advocates a wrong answer and then withdraws that pressure. We introduce a recovery-after-pressure protocol for multiple-choice factual dialogue and measure sycophancy hysteresis, the residual probability assigned to the user-advocated wrong answer relative to a clean-context counterfactual. Across seven instruction-tuned open-weight models and two factual benchmarks, ordinary reset often reduces but does not erase pressure-induced bias. History-preserving repairs such as user retraction, system reset, and self-verification recover only 2–3/14 model–dataset pairs under the strict clean-restoration diagnostic, whereas operations that change the effective context are substantially more reliable; the two conditions that remove the pressure-bearing history entirely, fresh-context deletion and context truncation, recover 14/14. In an oracle trusted-evidence condition across fourteen model–dataset pairs, preserving the pressure-bearing history while adding benchmark-derived trusted evidence increases accuracy from 0.368 to 0.929, while wrong-answer following falls from 41.2% to 4.3%. Controls show that the effect is not explained by dialogue length, repeated confidence, plausible distractors, mere false-answer mention, or option-label inertia. These results suggest that faithful grounded dialogue requires evaluating which prior context should be treated as evidence and which should be removed or quarantined before answering.
Anthology ID:
2026.groundlm-1.53
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
712–731
Language:
URL:
https://aclanthology.org/2026.groundlm-1.53/
DOI:
Bibkey:
Cite (ACL):
Adi Shnaidman. 2026. Reset Is Not Recovery: Evaluating Recoverability from False Conversational Context via Sycophancy Hysteresis. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 712–731, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reset Is Not Recovery: Evaluating Recoverability from False Conversational Context via Sycophancy Hysteresis (Shnaidman, GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.53.pdf