SCoNE : Selective Context-aware Neuron Editing for Robust Retrieval-Augmented Generation

Chaewon Kim, Seo Yeon Park


Abstract
Retrieval-Augmented Generation (RAG) is highly sensitive to retrieval noise: when retrieved documents mix informative and irrelevant context, LLMs are easily distracted, leading to hallucinations. To overcome this, we propose SCoNE (Selective Context-aware Neuron Editing), a training-free model editing approach that improves retrieval noise robustness by selectively strengthening context-aware FFN neurons that are identified by both high attribution and high cross-input variability. SCoNE requires only a small number of mining samples, no fine-tuning, and no inference-time overhead. Across various knowledge-intensive question-answering benchmarks and two LLM backbones, SCoNE consistently outperforms competitive baseline methods. Our code is available at https://github.com/HYU-ARK-Lab/SCoNE.
Anthology ID:
2026.emnlp-main.2126
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Junyi Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48352–48363
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2126/
DOI:
10.18653/2026.emnlp-main.2126
Bibkey:
Cite (ACL):
Chaewon Kim and Seo Yeon Park. 2026. SCoNE : Selective Context-aware Neuron Editing for Robust Retrieval-Augmented Generation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 48352–48363, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SCoNE : Selective Context-aware Neuron Editing for Robust Retrieval-Augmented Generation (Kim & Park, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2126.pdf