Automated Reformulation of Argumentative Essays to Improve Argument Organization and Development

Naomi James Sutcliffe de Moraes, Denis Deratani Mauá


Abstract
This work presents a study of automated reformulation of argumentative essays written by college-bound native speakers of Brazilian Portuguese as a form of pedagogical feedback. We first evaluate the feasibility of using large language models (LLMs) to score argument quality with respect to three criteria: the defense of a point of view, organization, and development. We then employ an LLM to provide a reformulated version of the essay as feedback. As we discuss, the main challenge is to constrain the automated feedback to address only argument quality, rather than improving other aspects such as spelling or cohesion, and to modify the essay as little as possible. We achieve levels of agreement in automatic essay scoring comparable to human inter-rater agreement metrics, while increasing explainability. Instructing the LLM to add argument support (facts, examples, etc.) was the best way to get non-superficial changes to the arguments, and it was able to add true examples and facts to the essays even without being provided with background information on the topic.
Anthology ID:
2026.propor-1.42
Volume:
Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 1
Month:
April
Year:
2026
Address:
Salvador, Brazil
Editors:
Marlo Souza, Iria de-Dios-Flores, Diana Santos, Larissa Freitas, Jackson Wilke da Cruz Souza, Eugénio Ribeiro
Venue:
PROPOR
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
425–435
Language:
URL:
https://aclanthology.org/2026.propor-1.42/
DOI:
Bibkey:
Cite (ACL):
Naomi James Sutcliffe de Moraes and Denis Deratani Mauá. 2026. Automated Reformulation of Argumentative Essays to Improve Argument Organization and Development. In Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 1, pages 425–435, Salvador, Brazil. Association for Computational Linguistics.
Cite (Informal):
Automated Reformulation of Argumentative Essays to Improve Argument Organization and Development (Moraes & Mauá, PROPOR 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.propor-1.42.pdf