Is writing style predictive of scientific fraud?

Chloé Braud, Anders Søgaard


Abstract
The problem of detecting scientific fraud using machine learning was recently introduced, with initial, positive results from a model taking into account various general indicators. The results seem to suggest that writing style is predictive of scientific fraud. We revisit these initial experiments, and show that the leave-one-out testing procedure they used likely leads to a slight over-estimate of the predictability, but also that simple models can outperform their proposed model by some margin. We go on to explore more abstract linguistic features, such as linguistic complexity and discourse structure, only to obtain negative results. Upon analyzing our models, we do see some interesting patterns, though: Scientific fraud, for examples, contains less comparison, as well as different types of hedging and ways of presenting logical reasoning.
Anthology ID:
W17-4905
Volume:
Proceedings of the Workshop on Stylistic Variation
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Julian Brooke, Thamar Solorio, Moshe Koppel
Venue:
Style-Var
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
37–42
Language:
URL:
https://aclanthology.org/W17-4905
DOI:
10.18653/v1/W17-4905
Bibkey:
Cite (ACL):
Chloé Braud and Anders Søgaard. 2017. Is writing style predictive of scientific fraud?. In Proceedings of the Workshop on Stylistic Variation, pages 37–42, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Is writing style predictive of scientific fraud? (Braud & Søgaard, Style-Var 2017)
Copy Citation:
PDF:
https://aclanthology.org/W17-4905.pdf