A Randomization-Control Diagnostic for Document Grounding in Self-Distillation Gates

Xiankun Lin, Lixin Liu, Xinyi Lin, Zhezheng Hao


Abstract
Self-distillation for grounded question answering often filters tutor trajectories with agreement or confidence gates. For such gates to support faithful grounding, their signals should depend on the supplied document rather than on answers recoverable from parametric memory. We propose a four-mode randomization-control diagnostic that applies the same frozen gate to original, randomized, irrelevant, and empty documents for the same question. On HotpotQA and MuSiQue, using Qwen2.5-7B-Instruct with eight tutor traces, the joint gate changes sharply with document condition: kept fraction falls from 0.380 to 0.020 and from 0.330 to 0.015, respectively. Randomized and irrelevant documents lie between the endpoints, while a document-blind random gate stays flat. The protocol audits document sensitivity without additional student training; faithful evidence use and downstream gains require separate validation.
Anthology ID:
2026.groundlm-1.32
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
412–417
Language:
URL:
https://aclanthology.org/2026.groundlm-1.32/
DOI:
Bibkey:
Cite (ACL):
Xiankun Lin, Lixin Liu, Xinyi Lin, and Zhezheng Hao. 2026. A Randomization-Control Diagnostic for Document Grounding in Self-Distillation Gates. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 412–417, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Randomization-Control Diagnostic for Document Grounding in Self-Distillation Gates (Lin et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.32.pdf
Attachment:
 2026.groundlm-1.32.attachment.zip