Two Approaches to Diachronic Normalization of Polish Texts

Kacper Dudzic, Filip Gralinski, Krzysztof Jassem, Marek Kubis, Piotr Wierzchon


Abstract
This paper discusses two approaches to the diachronic normalization of Polish texts: a rule-based solution that relies on a set of handcrafted patterns, and a neural normalization model based on the text-to-text transfer transformer architecture. The training and evaluation data prepared for the task are discussed in detail, along with experiments conducted to compare the proposed normalization solutions. A quantitative and qualitative analysis is made. It is shown that at the current stage of inquiry into the problem, the rule-based solution outperforms the neural one on 3 out of 4 variants of the prepared dataset, although in practice both approaches have distinct advantages and disadvantages.
Anthology ID:
2024.latechclfl-1.19
Volume:
Proceedings of the 8th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL 2024)
Month:
March
Year:
2024
Address:
St. Julians, Malta
Editors:
Yuri Bizzoni, Stefania Degaetano-Ortlieb, Anna Kazantseva, Stan Szpakowicz
Venues:
LaTeCHCLfL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
207–212
Language:
URL:
https://aclanthology.org/2024.latechclfl-1.19
DOI:
Bibkey:
Cite (ACL):
Kacper Dudzic, Filip Gralinski, Krzysztof Jassem, Marek Kubis, and Piotr Wierzchon. 2024. Two Approaches to Diachronic Normalization of Polish Texts. In Proceedings of the 8th Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL 2024), pages 207–212, St. Julians, Malta. Association for Computational Linguistics.
Cite (Informal):
Two Approaches to Diachronic Normalization of Polish Texts (Dudzic et al., LaTeCHCLfL-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.latechclfl-1.19.pdf
Supplementary material:
 2024.latechclfl-1.19.SupplementaryMaterial.tex