Automatically Ranked Russian Paraphrase Corpus for Text Generation

Vadim Gudkov, Olga Mitrofanova, Elizaveta Filippskikh


Abstract
The article is focused on automatic development and ranking of a large corpus for Russian paraphrase generation which proves to be the first corpus of such type in Russian computational linguistics. Existing manually annotated paraphrase datasets for Russian are limited to small-sized ParaPhraser corpus and ParaPlag which are suitable for a set of NLP tasks, such as paraphrase and plagiarism detection, sentence similarity and relatedness estimation, etc. Due to size restrictions, these datasets can hardly be applied in end-to-end text generation solutions. Meanwhile, paraphrase generation requires a large amount of training data. In our study we propose a solution to the problem: we collect, rank and evaluate a new publicly available headline paraphrase corpus (ParaPhraser Plus), and then perform text generation experiments with manual evaluation on automatically ranked corpora using the Universal Transformer architecture.
Anthology ID:
2020.ngt-1.6
Volume:
Proceedings of the Fourth Workshop on Neural Generation and Translation
Month:
July
Year:
2020
Address:
Online
Editors:
Alexandra Birch, Andrew Finch, Hiroaki Hayashi, Kenneth Heafield, Marcin Junczys-Dowmunt, Ioannis Konstas, Xian Li, Graham Neubig, Yusuke Oda
Venue:
NGT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
54–59
Language:
URL:
https://aclanthology.org/2020.ngt-1.6
DOI:
10.18653/v1/2020.ngt-1.6
Bibkey:
Cite (ACL):
Vadim Gudkov, Olga Mitrofanova, and Elizaveta Filippskikh. 2020. Automatically Ranked Russian Paraphrase Corpus for Text Generation. In Proceedings of the Fourth Workshop on Neural Generation and Translation, pages 54–59, Online. Association for Computational Linguistics.
Cite (Informal):
Automatically Ranked Russian Paraphrase Corpus for Text Generation (Gudkov et al., NGT 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.ngt-1.6.pdf
Video:
 http://slideslive.com/38929819
Data
Opusparcus