AdaPE: Adaptive Editing Strength for Batch Knowledge Editing in Large Language Models

Jinjin Qian, Yunqi Mi, Zeyu Song, Guoshuai Zhao, Xueming Qian


Abstract
Large language models (LLMs) encode vast amounts of knowledge in their parameters, but these facts often require precise post-training rectification as they become outdated or incorrect over time. Traditional batch editing methods typically apply a uniform update strength across all instances. However, this uniform approach ignores the inherent variation in editing difficulty, leading to a fundamental trade-off between correction success and model stability. To overcome this limitation, we introduce AdaPE (Adaptive Pressure Editing), a parameter-free adaptive editing framework that dynamically adjusts the update behavior for each specific instance. Specifically, we derive a closed-form adaptive update rate based on the ratio of residual energy to spatial sensitivity, which strictly quantifies the intrinsic injection difficulty. This formulation adaptively limits the update strength for difficult facts to preserve model locality, while ensuring sufficient knowledge injection for easier ones. Extensive experiments on three benchmarks and two prominent LLMs demonstrate the superiority of our approach in consistently circumventing the fixed-strength bottleneck, achieving a new state-of-the-art balance between editing efficacy and model integrity. Our code is available at https://github.com/skyandkibo/adape.
Anthology ID:
2026.findings-emnlp.62
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1257–1275
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.62/
DOI:
Bibkey:
Cite (ACL):
Jinjin Qian, Yunqi Mi, Zeyu Song, Guoshuai Zhao, and Xueming Qian. 2026. AdaPE: Adaptive Editing Strength for Batch Knowledge Editing in Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 1257–1275, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AdaPE: Adaptive Editing Strength for Batch Knowledge Editing in Large Language Models (Qian et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.62.pdf