Can Model Editing Survive Fine-Tuning? Evaluating Robustness and Persistence in Text-to-Image Diffusion Models

Feng He, Marco Valentino, Zhixue Zhao


Abstract
Model editing enables targeted behavioral changes in pre-trained models without costly retraining, supporting applications such as factual correction, debiasing, and safety mitigation. In practice, models are often subsequently fine-tuned for downstream tasks, raising the question of whether edits persist or are reversed during fine-tuning. Understanding this interaction is critical for AI safety, as fine-tuning may either remediate malicious edits or inadvertently undo beneficial ones. We systematically study the impact of subsequent fine-tuning on model editing in text-to-image models. Using two model families (Stable Diffusion and FLUX), five editing methods, and four fine-tuning approaches, we evaluate edit retention of multiple editing objectives under fine-tuning on unrelated tasks. Across models, methods, and metrics, we find that fine-tuning moderately weakens appearance and debiasing edits, while somewhat strengthening edits that remove unsafe content, e.g., for appearance editing, fine-tuning reverses avg. 6.78% editing effect across methods. Further, we provide a mechanistic analysis of edit preservation by examining cross-attention representations and disentangling update magnitude from functional behavioral impact, finding that robustness is associated with systematic representation shifts and limited interference with the edited components. These findings highlight the need for monitoring and, when necessary, reapplying edits in model deployment pipelines.
Anthology ID:
2026.findings-aacl.96
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1926–1946
Language:
URL:
https://aclanthology.org/2026.findings-aacl.96/
DOI:
Bibkey:
Cite (ACL):
Feng He, Marco Valentino, and Zhixue Zhao. 2026. Can Model Editing Survive Fine-Tuning? Evaluating Robustness and Persistence in Text-to-Image Diffusion Models. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 1926–1946, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Can Model Editing Survive Fine-Tuning? Evaluating Robustness and Persistence in Text-to-Image Diffusion Models (He et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.96.pdf