Automatic Normalisation of Middle French and Its Impact on Productivity

Raphael Rubino, Sandra Coram-Mekkey, Johanna Gerlach, Jonathan David Mutal, Pierrette Bouillon


Abstract
This paper presents a study on automatic normalisation of 16th century documents written in Middle French. These documents present a large variety of wordforms which require spelling normalisation to facilitate downstream linguistic and historical studies. We frame the normalisation process as a machine translation task starting with a strong baseline leveraging a pre-trained encoder–decoder model. We propose to improve this baseline by combining synthetic data generation methods and producing artificial training data, thus tackling the lack of parallel corpora relevant to our task. The evaluation of our approach is twofold, in addition to automatic metrics relying on gold references, we evaluate our models through post-editing of their outputs. This evaluation method directly measures the productivity gain brought by our models to experts conducting the normalisation task manually. Results show a 20+ token per minute increase in productivity when using automatic normalisation compared to normalising text from scratch. The manually post-edited dataset resulting from our study is the first parallel corpus of normalised 16th century Middle French to be publicly released, along with the synthetic data and the automatic normalisation models used and trained in the presented work.
Anthology ID:
2024.lt4hala-1.20
Volume:
Proceedings of the Third Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA) @ LREC-COLING-2024
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Rachele Sprugnoli, Marco Passarotti
Venues:
LT4HALA | WS
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
176–189
Language:
URL:
https://aclanthology.org/2024.lt4hala-1.20
DOI:
Bibkey:
Cite (ACL):
Raphael Rubino, Sandra Coram-Mekkey, Johanna Gerlach, Jonathan David Mutal, and Pierrette Bouillon. 2024. Automatic Normalisation of Middle French and Its Impact on Productivity. In Proceedings of the Third Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA) @ LREC-COLING-2024, pages 176–189, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Automatic Normalisation of Middle French and Its Impact on Productivity (Rubino et al., LT4HALA-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lt4hala-1.20.pdf