You Write like a GPT

Andrea Esuli, Fabrizio Falchi, Marco Malvaldi, Giovanni Puccetti


Abstract
We investigate how Raymond Queneau’s Exercises in Style are evaluated by automatic methods for detection of artificially-generated text. We work with the Queneau’s original French version, the Italian translation by Umberto Eco andthe English translation by Barbara Wright.We start by comparing how various methods for the detection of automatically generated text, also using different large language models and evaluate the different styles in the opera. We then link this automatic evaluation to distinct characteristic related to content and structure of the various styles.This work is an initial attempt at exploring how methods for detection artificially-generated text can find application as tools to evaluate the qualities and characteristics of human writing, to support better writing in terms of originality, informativeness, clarity.
Anthology ID:
2024.clicit-1.41
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
343–348
Language:
URL:
https://aclanthology.org/2024.clicit-1.41/
DOI:
Bibkey:
Cite (ACL):
Andrea Esuli, Fabrizio Falchi, Marco Malvaldi, and Giovanni Puccetti. 2024. You Write like a GPT. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 343–348, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
You Write like a GPT (Esuli et al., CLiC-it 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.clicit-1.41.pdf