Analysing Zero-Shot Readability-Controlled Sentence Simplification

Abdullah Barayan, Jose Camacho-Collados, Fernando Alva-Manchego


Abstract
Readability-controlled text simplification (RCTS) rewrites texts to lower readability levels while preserving their meaning. RCTS models often depend on parallel corpora with readability annotations on both source and target sides. Such datasets are scarce and difficult to curate, especially at the sentence level. To reduce reliance on parallel data, we explore using instruction-tuned large language models for zero-shot RCTS. Through automatic and manual evaluations, we examine: (1) how different types of contextual information affect a model’s ability to generate sentences with the desired readability, and (2) the trade-off between achieving target readability and preserving meaning. Results show that all tested models struggle to simplify sentences (especially to the lowest levels) due to models’ limitations and characteristics of the source sentences that impede adequate rewriting. Our experiments also highlight the need for better automatic evaluation metrics tailored to RCTS, as standard ones often misinterpret common simplification operations, and inaccurately assess readability and meaning preservation.
Anthology ID:
2025.coling-main.452
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6762–6781
Language:
URL:
https://aclanthology.org/2025.coling-main.452/
DOI:
Bibkey:
Cite (ACL):
Abdullah Barayan, Jose Camacho-Collados, and Fernando Alva-Manchego. 2025. Analysing Zero-Shot Readability-Controlled Sentence Simplification. In Proceedings of the 31st International Conference on Computational Linguistics, pages 6762–6781, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Analysing Zero-Shot Readability-Controlled Sentence Simplification (Barayan et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.452.pdf