Iterative Document Representation Learning Towards Summarization with Polishing

Xiuying Chen, Shen Gao, Chongyang Tao, Yan Song, Dongyan Zhao, Rui Yan


Abstract
In this paper, we introduce Iterative Text Summarization (ITS), an iteration-based model for supervised extractive text summarization, inspired by the observation that it is often necessary for a human to read an article multiple times in order to fully understand and summarize its contents. Current summarization approaches read through a document only once to generate a document representation, resulting in a sub-optimal representation. To address this issue we introduce a model which iteratively polishes the document representation on many passes through the document. As part of our model, we also introduce a selective reading mechanism that decides more accurately the extent to which each sentence in the model should be updated. Experimental results on the CNN/DailyMail and DUC2002 datasets demonstrate that our model significantly outperforms state-of-the-art extractive systems when evaluated by machines and by humans.
Anthology ID:
D18-1442
Volume:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
Month:
October-November
Year:
2018
Address:
Brussels, Belgium
Editors:
Ellen Riloff, David Chiang, Julia Hockenmaier, Jun’ichi Tsujii
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
4088–4097
Language:
URL:
https://aclanthology.org/D18-1442
DOI:
10.18653/v1/D18-1442
Bibkey:
Cite (ACL):
Xiuying Chen, Shen Gao, Chongyang Tao, Yan Song, Dongyan Zhao, and Rui Yan. 2018. Iterative Document Representation Learning Towards Summarization with Polishing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4088–4097, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Iterative Document Representation Learning Towards Summarization with Polishing (Chen et al., EMNLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/D18-1442.pdf
Attachment:
 D18-1442.Attachment.pdf
Code
 yingtaomj/Iterative-Document-Representation-Learning-Towards-Summarization-with-Polishing
Data
CNN/Daily Mail