A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models

Yassir El Attar, Esra Dönmez, Maximilian Maurer, Agnieszka Falenska


Abstract
Interpretable linguistic features offer a promising approach for explaining *why* a given text appears machine-generated, particularly for non-expert users. However, existing findings on which features reliably indicate LLM-generated text remain fragmented across feature sets, models, and text domains. To address this gap, we conduct a large-scale empirical study assessing the robustness of linguistic signals for characterizing AI-generated text. Our analysis covers 284 interpretable linguistic features across outputs from 30 LLMs and 10 text domains under cross-model and cross-domain generalization settings. We show that classifiers based solely on linguistic features can reliably distinguish AI-generated from human-written text. However, many previously proposed indicators prove strongly context-dependent, with the exception of measures of lexical richness, which remain robust signals across model families and text domains. These results demonstrate which linguistic signals generalize across contexts and provide a foundation for more reliable, interpretable analyses of AI-generated language.
Anthology ID:
2026.findings-aacl.10
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
181–208
Language:
URL:
https://aclanthology.org/2026.findings-aacl.10/
DOI:
Bibkey:
Cite (ACL):
Yassir El Attar, Esra Dönmez, Maximilian Maurer, and Agnieszka Falenska. 2026. A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 181–208, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models (El Attar et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.10.pdf