GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping

Chahana Dahal, Ashutosh Balasubramaniam, Zuobin Xiong


Abstract
Unlearning knowledge is a pressing and challenging task in LLMs because of their unprecedented capability to memorize and digest training data at scale, raising more significant issues on safety, privacy, and intellectual property. However, existing works, including parameter editing, fine-tuning, and distillation-based methods, are all focused on the flat sentence-level data but overlook the relational, multi-hop, and reasoned knowledge in the naturally structured data. In response to this gap, this paper introduces Graph Oblivion and Node Erasure (GONE), a benchmark for evaluating knowledge unlearning over structured knowledge graphs (KGs) facts in LLMs. This KG-based benchmark enables the disentanglement of three effects of unlearning: direct fact removal, reasoning-based leakage, and catastrophic forgetting. In addition, Neighborhood-Expanded Distribution Shaping (NEDS), a novel unlearning framework, is designed to leverage graph connectivity and identify anchor correlated neighbors, enforcing a precise decision boundary between the forgotten fact and its semantic neighborhood. Evaluations on LLaMA-3-8B and Mistral-7B across multiple knowledge editing and unlearning methods showcase the superior performance (1.000 on unlearning efficacy and 0.839 on locality) of NEDS on GONE and other benchmarks.
Anthology ID:
2026.findings-emnlp.106
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2173–2193
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.106/
DOI:
Bibkey:
Cite (ACL):
Chahana Dahal, Ashutosh Balasubramaniam, and Zuobin Xiong. 2026. GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 2173–2193, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GONE: Structural Knowledge Unlearning via Neighborhood-Expanded Distribution Shaping (Dahal et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.106.pdf