R²Edit: Mastering Relation Replacement Editing via Target-Smoothed Forgetting and Self-Paced Learning

Xu Cao, Xinrui Chen, Qing Liu, Mengyang Li, Ou Wu, Yi Du


Abstract
Knowledge editing updates facts in large language models while preserving unrelated knowledge. Most prior work studies object editing, which modifies the object under a fixed subject–relation pair. We instead study relation replacement editing, where an obsolete relation must be suppressed as a new one is introduced. We systematically study this setting with a dedicated benchmark and method. We introduce ReEditBench to evaluate replacement rather than association addition. Existing editors exhibit two major failures: obsolete-relation retention remains as high as 98.20% after successful edits, and difficult samples often destabilize editing. To address this, we propose R2Edit, a two-stage framework for relation replacement. Its target-smoothed Forget stage reduces obsolete-relation activation without fixed/random pseudo-target bias, while its curriculum-guided Edit stage progressively injects new relations from easy to hard samples. Across multiple LLMs, R2Edit improves replacement success, reduces retention, and preserves generalization. Stress tests on difficult subsets further demonstrate the robustness of the Edit stage. Code is available at: https://github.com/caoxu0109/R2Edit.
Anthology ID:
2026.emnlp-main.869
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
20096–20123
Language:
URL:
https://aclanthology.org/2026.emnlp-main.869/
DOI:
Bibkey:
Cite (ACL):
Xu Cao, Xinrui Chen, Qing Liu, Mengyang Li, Ou Wu, and Yi Du. 2026. R²Edit: Mastering Relation Replacement Editing via Target-Smoothed Forgetting and Self-Paced Learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 20096–20123, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
R²Edit: Mastering Relation Replacement Editing via Target-Smoothed Forgetting and Self-Paced Learning (Cao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.869.pdf