Neurobiber: Fast and Interpretable Linguistic Feature Extraction

Kenan Alkiek, Anna Wegmann, Jian Zhu, David Jurgens


Abstract
Linguistic style is central to how texts convey meaning and to tasks from register analysis to authorship verification, yet extracting detailed stylistic features at scale is hard: rule-based taggers are interpretable but slow, while neural style embeddings are fast but opaque. We present Neurobiber, a RoBERTa tagger that predicts 96 interpretable features from Biber’s Multidimensional Analysis in a single forward pass, bringing this analysis to corpus scale: a one-billion-token corpus tags on a single GPU in about 9.5 hours, over an order of magnitude faster than single-thread taggers. Neurobiber is trained on BiberPlus, a new open-source rule tagger that computes the same 96 features deterministically from explicit rules and ships built-in analytics such as PCA and factor analysis; users tag at scale with Neurobiber and fall back to BiberPlus for exact, auditable counts. Neurobiber reproduces BiberPlus at 0.97 macro-F1; its features recover Biber’s primary dimension of variation, and on PAN 2020 authorship verification they contribute signal complementary to a strong neural encoder. Both tools are released openly, with a live demo.
Anthology ID:
2026.emnlp-demos.61
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
639–650
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.61/
DOI:
Bibkey:
Cite (ACL):
Kenan Alkiek, Anna Wegmann, Jian Zhu, and David Jurgens. 2026. Neurobiber: Fast and Interpretable Linguistic Feature Extraction. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 639–650, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Neurobiber: Fast and Interpretable Linguistic Feature Extraction (Alkiek et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.61.pdf