Accelerating Sparse Autoencoder Training via Layer-Wise Transfer Learning in Large Language Models

Accelerating Sparse Autoencoder Training via Layer-Wise Transfer Learning in Large Language Models Davide Ghilardi author Federico Belotti author Marco Molinari author Jaehyuk Lim author 2024-11 text Proceedings of the 7th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP Yonatan Belinkov editor Najoung Kim editor Jaap Jumelet editor Hosein Mohebbi editor Aaron Mueller editor Hanjie Chen editor Association for Computational Linguistics Miami, Florida, US conference publication ghilardi-etal-2024-accelerating 10.18653/v1/2024.blackboxnlp-1.32 https://aclanthology.org/2024.blackboxnlp-1.32/ 2024-11 530 550