Key Path Identification for Resolving Knowledge Conflicts via SAE-based Steering

Wenbo Zhang, Zhongxiang Sun, Zhiguang Han, Jun Xu


Abstract
Sparse autoencoder (SAE)-based steering has been widely used to address knowledge conflicts by guiding LLMs to be more faithful to the contextual knowledge. Existing methods usually perform mass steering, which modifies a large batch of SAE features identified via correlation-based methods. However, due to the inaccurate correlation and the neglected feature interactions, mass steering methods fail to precisely identify the features that play the key roles in steering and introduce a large number of redundant ones, which add noise and weaken the steering effects. Our empirical studies reveal that steering only a small subset of the identified features can achieve comparable or even better performance. Motivated by this finding, we propose Key Path Identification (KPI), a novel method that identifies key steering features characterized by strong causal dependencies with both upstream and downstream features. From these features, KPI constructs key paths and steers through less feature modifications. In this way, KPI advances SAE-based steering from quantity-driven to quality-focused, offering a perspective for more precise and interpretable model editing. Experiments in RAG tasks with knowledge conflicts show that our method improves the accuracy by 18% on average compared to the best baseline of mass steering, effectively filtering redundant features, alleviating side effects and demonstrating the core role of key paths in steering.
Anthology ID:
2026.emnlp-main.857
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
19851–19870
Language:
URL:
https://aclanthology.org/2026.emnlp-main.857/
DOI:
Bibkey:
Cite (ACL):
Wenbo Zhang, Zhongxiang Sun, Zhiguang Han, and Jun Xu. 2026. Key Path Identification for Resolving Knowledge Conflicts via SAE-based Steering. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 19851–19870, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Key Path Identification for Resolving Knowledge Conflicts via SAE-based Steering (Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.857.pdf