Marco Malvaldi


2024

pdf bib
You Write like a GPT
Andrea Esuli | Fabrizio Falchi | Marco Malvaldi | Giovanni Puccetti
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)

We investigate how Raymond Queneau’s Exercises in Style are evaluated by automatic methods for detection of artificially-generated text. We work with the Queneau’s original French version, the Italian translation by Umberto Eco andthe English translation by Barbara Wright.We start by comparing how various methods for the detection of automatically generated text, also using different large language models and evaluate the different styles in the opera. We then link this automatic evaluation to distinct characteristic related to content and structure of the various styles.This work is an initial attempt at exploring how methods for detection artificially-generated text can find application as tools to evaluate the qualities and characteristics of human writing, to support better writing in terms of originality, informativeness, clarity.