MinWikiSplit: A Sentence Splitting Corpus with Minimal Propositions

Christina Niklaus, André Freitas, Siegfried Handschuh


Abstract
We compiled a new sentence splitting corpus that is composed of 203K pairs of aligned complex source and simplified target sentences. Contrary to previously proposed text simplification corpora, which contain only a small number of split examples, we present a dataset where each input sentence is broken down into a set of minimal propositions, i.e. a sequence of sound, self-contained utterances with each of them presenting a minimal semantic unit that cannot be further decomposed into meaningful propositions. This corpus is useful for developing sentence splitting approaches that learn how to transform sentences with a complex linguistic structure into a fine-grained representation of short sentences that present a simple and more regular structure which is easier to process for downstream applications and thus facilitates and improves their performance.
Anthology ID:
W19-8615
Volume:
Proceedings of the 12th International Conference on Natural Language Generation
Month:
October–November
Year:
2019
Address:
Tokyo, Japan
Editors:
Kees van Deemter, Chenghua Lin, Hiroya Takamura
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
118–123
Language:
URL:
https://aclanthology.org/W19-8615
DOI:
10.18653/v1/W19-8615
Bibkey:
Cite (ACL):
Christina Niklaus, André Freitas, and Siegfried Handschuh. 2019. MinWikiSplit: A Sentence Splitting Corpus with Minimal Propositions. In Proceedings of the 12th International Conference on Natural Language Generation, pages 118–123, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
MinWikiSplit: A Sentence Splitting Corpus with Minimal Propositions (Niklaus et al., INLG 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-8615.pdf