When Should an Agent Distrust Its Own Context? Model-Dependent Outcomes of an Audited Reasoning Pipeline

Aditya Channa, Madhav Kapoor, Jastej Singh


Abstract
Agents grounded in heterogeneous sources often encounter conflicting evidence. We study an Audited Reasoning Pipeline (ARP): a forensic analyzer reads the raw sources and emits a sanitized diagnostic, while a clean-room synthesis stage receives the question and diagnostic but not the raw context. On 100 corrupted ConflictQA instances per model, ARP raises exact match from 15 to 30 for GPT-OSS-120B and from 19 to 29 for MiniMax-M2.5.CAT-Source changes from 40 to 49 and from 74 to 56, respectively; their paired model-by-condition interaction is 27 points (95% CI [13,41], p < .001), although two model/configuration pairs do not identify capability as its cause. The three diagnostic metrics are emitted before the clean-room boundary, and all items are corrupted, so conflict detection has no false-positive evaluation. Token-F1 also falls on multi-answer questions. Because the clean four-call control that gives Stage 4 both raw context and the diagnostic was not run, the air- gap’s causal effect remains unidentified.
Anthology ID:
2026.groundlm-1.34
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
434–440
Language:
URL:
https://aclanthology.org/2026.groundlm-1.34/
DOI:
Bibkey:
Cite (ACL):
Aditya Channa, Madhav Kapoor, and Jastej Singh. 2026. When Should an Agent Distrust Its Own Context? Model-Dependent Outcomes of an Audited Reasoning Pipeline. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 434–440, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
When Should an Agent Distrust Its Own Context? Model-Dependent Outcomes of an Audited Reasoning Pipeline (Channa et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.34.pdf