Evaluating Style Embeddings for Machine-Generated Text Detection

Noé Durandard, Saurabh Dhawan, Thierry Poibeau


Abstract
In this paper, we evaluate the use of style embeddings for distinguishing machine-generated from human-written text. Style embeddings are particularly suited for this task as compared to semantic embeddings, they offer higher content-independence, and compared to feature-engineering approaches, they offer a richer and more holistic representation of writing style. We use a detection module in which texts are first embedded in high-dimensional stylistic spaces using a style encoder, and the resulting vector representations are classified using supervised methods. To optimize this detector, we evaluate the performance of a range of pre-trained public-domain style encoders paired with different supervised methods. When evaluated on MGTBench, a widely adopted benchmark, our approach matches or exceeds state-of-the-art performance metrics. It also generalizes well across various text domains and LLMs. Our findings highlight the potential, and would facilitate the use, of style embeddings as lightweight and effective components of machine-generated text detection systems.
Anthology ID:
2026.lrec-1.205
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
2619–2628
Language:
External URL:
https://lrec.elra.info/lrec2026-main-205
DOI:
10.63317/5hb2q2wfzabd
Bibkey:
Cite (ACL):
Noé Durandard, Saurabh Dhawan, and Thierry Poibeau. 2026. Evaluating Style Embeddings for Machine-Generated Text Detection. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 2619–2628, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Evaluating Style Embeddings for Machine-Generated Text Detection (Durandard et al., LREC 2026)
Copy Citation: