huPWKP: A Hungarian Text Simplification Corpus

Noémi Prótár, Dávid Márk Nemeskey


Abstract
In this article we introduce huPWKP, the first parallel corpus consisting of Hungarian standard language-simplified sentence pairs. As Hungarian is a quite low-resource language in regards to text simplification, we opted for translating an already existing corpus, PWKP (Zhu et al., 2010), on which we performed some cleaning in order to improve its quality. We evaluated the corpus both with the help of human evaluators and by training a seq2seq model on both the Hungarian corpus and the original (cleaned) English corpus. The Hungarian model performed slightly worse in terms of automatic metrics; however, the English model attains a SARI score close to the state of the art on the official PWKP set. According to the human evaluation, the corpus performs at around 3 on a scale ranging from 1 to 5 in terms of information retention and increase in simplification and around 3.7 in terms of grammaticality.
Anthology ID:
2023.ranlp-1.97
Volume:
Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
Month:
September
Year:
2023
Address:
Varna, Bulgaria
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
898–907
Language:
URL:
https://aclanthology.org/2023.ranlp-1.97
DOI:
Bibkey:
Cite (ACL):
Noémi Prótár and Dávid Márk Nemeskey. 2023. huPWKP: A Hungarian Text Simplification Corpus. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 898–907, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
huPWKP: A Hungarian Text Simplification Corpus (Prótár & Nemeskey, RANLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.ranlp-1.97.pdf