ParaRev : Building a dataset for Scientific Paragraph Revision annotated with revision instruction

Léane Jourdan, Florian Boudin, Richard Dufour, Nicolas Hernandez, Akiko Aizawa


Abstract
Revision is a crucial step in scientific writing, where authors refine their work to improve clarity, structure, and academic quality. Existing approaches to automated writing assistance often focus on sentence-level revisions, which fail to capture the broader context needed for effective modification. In this paper, we explore the impact of shifting from sentence-level to paragraph-level scope for the task of scientific text revision. The paragraph level definition of the task allows for more meaningful changes, and is guided by detailed revision instructions rather than general ones. To support this task, we introduce ParaRev, the first dataset of revised scientific paragraphs with an evaluation subset manually annotated with revision instructions. Our experiments demonstrate that using detailed instructions significantly improves the quality of automated revisions compared to general approaches, no matter the model or the metric considered.
Anthology ID:
2025.wraicogs-1.4
Volume:
Proceedings of the First Workshop on Writing Aids at the Crossroads of AI, Cognitive Science and NLP (WRAICOGS 2025)
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Michael Zock, Kentaro Inui, Zheng Yuan
Venues:
WRAICOGS | WS
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
35–44
Language:
URL:
https://aclanthology.org/2025.wraicogs-1.4/
DOI:
Bibkey:
Cite (ACL):
Léane Jourdan, Florian Boudin, Richard Dufour, Nicolas Hernandez, and Akiko Aizawa. 2025. ParaRev : Building a dataset for Scientific Paragraph Revision annotated with revision instruction. In Proceedings of the First Workshop on Writing Aids at the Crossroads of AI, Cognitive Science and NLP (WRAICOGS 2025), pages 35–44, Abu Dhabi, UAE. International Committee on Computational Linguistics.
Cite (Informal):
ParaRev : Building a dataset for Scientific Paragraph Revision annotated with revision instruction (Jourdan et al., WRAICOGS 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.wraicogs-1.4.pdf