Is Safety Grounded or Detachable? Removal-Cost Audits for Open-Weight Language Models

Nedim Mutlu Sezer, Ömer Faruk Aksoy, Feyzi Arda Salihoğlu, Yağız Ekrem Dalar, Ahmet Rıfat Öztürk


Abstract
Open-weight language models remain modifiable after release, so release-time refusal alone cannot establish durable safety. We introduce removal-cost grounding as a budget-conditioned audit of whether safety can be weakened while preserving utility, coherent generation, and benign helpfulness. We formalize clean removal as a constrained feasibility problem and distinguish observed counterexamples from inconclusive attack searches. Mycelium v0 provides a deliberately limited case study: four model families exhibit benchmark degradation under an archived removal configuration, while targeted Mistral controls separate destructive ablation from wrapper bypass. A provenance audit excludes three model–task comparisons with mismatched evaluation limits or conflicting snapshots. Across the retained comparisons, mean removal-associated score changes range from -0.382 to -0.185. In a separate 12-prompt generation panel, the strict attack-success proxy increases from 1/12 with Mycelium enabled to 7/12 under bypass, with wide uncertainty and no matched native safety baseline. Adaptive traces further show why early-stopped checkpoints must be distinguished from training endpoints. These observations do not establish tamper-resistant safety. They motivate an auditable reporting framework in which the cheapest admissible route to useful unsafe behavior, rather than the costliest destructive ablation, determines the strength of a safety claim.
Anthology ID:
2026.groundlm-1.12
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
148–160
Language:
URL:
https://aclanthology.org/2026.groundlm-1.12/
DOI:
Bibkey:
Cite (ACL):
Nedim Mutlu Sezer, Ömer Faruk Aksoy, Feyzi Arda Salihoğlu, Yağız Ekrem Dalar, and Ahmet Rıfat Öztürk. 2026. Is Safety Grounded or Detachable? Removal-Cost Audits for Open-Weight Language Models. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 148–160, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Is Safety Grounded or Detachable? Removal-Cost Audits for Open-Weight Language Models (Sezer et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.12.pdf
Attachment:
 2026.groundlm-1.12.attachment.zip