Intervention-Certified Amplification: A Validity Gate for 𝜎-Weighted Post-Training

Leiyue Chen, Meng Wei, Xuefeng Hu, Wei Liu


Abstract
Post-training methods use training-side signals to decide which supervision to emphasize, but those signals need not identify behavior that is capability-bearing in the target environment. We probe this with DIAA (Dual-Implicit Adversarial Amplification), a per-sample σ = sigmoid(-βΔ) SFT/RL hybrid: after every literal Python code fence is deleted from the anchor data, the model still emits unexecuted Tool-Integrated Reasoning (TIR) form on 29% of MATH-500 prompts, three times vanilla GRPO, and suppressing the form recovers accuracy. A paired within-prompt intervention decomposes the removable drag along GRPO → SFT → DIAA as +2.2 → +8.5 → +10.6 pp, identifying SFT imitation and σ-amplification as comparable sources; a teacher RFT with 0% TIR likewise trains a student emitting TIR at 45.8%. We propose Intervention-Certified Amplification (ICA), which gates the per-sample weight by a certificate derived from paired rollouts, σ_eff(x) = σ(x)·c(x; θ_c). Frozen and online instantiations cut TIR to 13.8% and 11.2%, more than halve residual drag while improving accuracy, and carry the joint improvement to held-out GSM8K without retuning the certificate.
Anthology ID:
2026.findings-emnlp.2090
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44510–44522
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2090/
DOI:
Bibkey:
Cite (ACL):
Leiyue Chen, Meng Wei, Xuefeng Hu, and Wei Liu. 2026. Intervention-Certified Amplification: A Validity Gate for 𝜎-Weighted Post-Training. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 44510–44522, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Intervention-Certified Amplification: A Validity Gate for 𝜎-Weighted Post-Training (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2090.pdf