Russian Generative Spelling, Punctuation and Capitalization Correction

Nikita Martynov, Danil Astafurov, Ulyana Isaeva, Ivan Vasil’yevich Maksimov, Joqsan Azocar, Dmitrii Kosenko, Alena Fenogenova


Abstract
This paper presents SAGE, an open-access framework that encloses a set of models specifically designed for the generative correction of spelling, punctuation, and capitalization errors in Russian. The release includes four models, featuring a Russian-English version and a distilled version for easy use and cost-effectiveness. The models are pre-trained using a sequence-to-sequence approach on artificial errors that mimic human mistakes and fine-tuned on annotated multi-domain texts. A set of carefully engineered auxiliary learning objectives is employed during pre-training to enrich the models with additional semantic and syntactic information. Evaluations indicate that SAGE models, despite having a small number of parameters, outperform top-tier multilingual and Russian-specific large language models, including both closed- and open-source options, and are considered state-of-the-art. We release the online demo powered by a single Nvidia A100 80GB GPU as a Web service, which allows to simultaneously test the most advanced SAGE model of 1.7B parameters, its distilled version and the Russian-English SAGE model.
Anthology ID:
2026.lrec-1.773
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
9861–9872
Language:
External URL:
https://lrec.elra.info/lrec2026-main-773
DOI:
10.63317/2gv3b9npuo2s
Bibkey:
Cite (ACL):
Nikita Martynov, Danil Astafurov, Ulyana Isaeva, Ivan Vasil’yevich Maksimov, Joqsan Azocar, Dmitrii Kosenko, and Alena Fenogenova. 2026. Russian Generative Spelling, Punctuation and Capitalization Correction. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 9861–9872, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Russian Generative Spelling, Punctuation and Capitalization Correction (Martynov et al., LREC 2026)
Copy Citation: