Dilated Convolutional Neural Networks for Lightweight Diacritics Restoration

Bálint Csanády, András Lukács


Abstract
Diacritics restoration has become a ubiquitous task in the Latin-alphabet-based English-dominated Internet language environment. In this paper, we describe a small footprint 1D dilated convolution-based approach which operates on a character-level. We find that neural networks based on 1D dilated convolutions are competitive alternatives to solutions based on recurrent neural networks or linguistic modeling for the task of diacritics restoration. Our approach surpasses the performance of similarly sized models and is also competitive with larger models. A special feature of our solution is that it even runs locally in a web browser. We also provide a working example of this browser-based implementation. Our model is evaluated on different corpora, with emphasis on the Hungarian language. We performed comparative measurements about the generalization power of the model in relation to three Hungarian corpora. We also analyzed the errors to understand the limitation of corpus-based self-supervised training.
Anthology ID:
2022.lrec-1.452
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
4253–4259
Language:
URL:
https://aclanthology.org/2022.lrec-1.452
DOI:
Bibkey:
Cite (ACL):
Bálint Csanády and András Lukács. 2022. Dilated Convolutional Neural Networks for Lightweight Diacritics Restoration. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 4253–4259, Marseille, France. European Language Resources Association.
Cite (Informal):
Dilated Convolutional Neural Networks for Lightweight Diacritics Restoration (Csanády & Lukács, LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.452.pdf
Code
 aielte-research/diacritics_restoration