TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts

Sajad Sotudeh, Hanieh Deilamsalehy, Franck Dernoncourt, Nazli Goharian


Abstract
Recent models in developing summarization systems consist of millions of parameters and the model performance is highly dependent on the abundance of training data. While most existing summarization corpora contain data in the order of thousands to one million, generation of large-scale summarization datasets in order of couple of millions is yet to be explored. Practically, more data is better at generalizing the training patterns to unseen data. In this paper, we introduce TLDR9+ –a large-scale summarization dataset– containing over 9 million training instances extracted from Reddit discussion forum ([HTTP]). This dataset is specifically gathered to perform extreme summarization (i.e., generating one-sentence summary in high compression and abstraction) and is more than twice larger than the previously proposed dataset. We go one step further and with the help of human annotations, we distill a more fine-grained dataset by sampling High-Quality instances from TLDR9+ and call it TLDRHQ dataset. We further pinpoint different state-of-the-art summarization models on our proposed datasets.
Anthology ID:
2021.newsum-1.15
Volume:
Proceedings of the Third Workshop on New Frontiers in Summarization
Month:
November
Year:
2021
Address:
Online and in Dominican Republic
Editors:
Giuseppe Carenini, Jackie Chi Kit Cheung, Yue Dong, Fei Liu, Lu Wang
Venue:
NewSum
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
142–151
Language:
URL:
https://aclanthology.org/2021.newsum-1.15
DOI:
10.18653/v1/2021.newsum-1.15
Bibkey:
Cite (ACL):
Sajad Sotudeh, Hanieh Deilamsalehy, Franck Dernoncourt, and Nazli Goharian. 2021. TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts. In Proceedings of the Third Workshop on New Frontiers in Summarization, pages 142–151, Online and in Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts (Sotudeh et al., NewSum 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.newsum-1.15.pdf
Code
 sajastu/reddit_collector
Data
TLDR9+Reddit TIFU