The GRADIEND Python Package: An End-to-End System for Gradient-Based Feature Learning

Jonathan Drechsel, Steffen Herbold


Abstract
We present ‘gradiend‘, an open-source Python package that operationalizes the GRADIEND method for learning feature directions from factual-counterfactual MLM and CLM gradients in language models. The package provides a unified workflow for feature-related data creation, training, evaluation, visualization, persistent model rewriting via controlled weight updates, and multi-feature comparison. We demonstrate ‘gradiend‘ through an English pronoun running example, a semantic sentiment use case that evaluates lexical generalization to held-out target words, and a large-scale feature comparison.
Anthology ID:
2026.emnlp-demos.18
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
189–198
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.18/
DOI:
Bibkey:
Cite (ACL):
Jonathan Drechsel and Steffen Herbold. 2026. The GRADIEND Python Package: An End-to-End System for Gradient-Based Feature Learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 189–198, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The GRADIEND Python Package: An End-to-End System for Gradient-Based Feature Learning (Drechsel & Herbold, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.18.pdf