Factual Relation Discrimination for Factuality-oriented Abstractive Summarization

Zhiguang Gao, Peifeng Li, Feng Jiang, Xiaomin Chu, Qiaoming Zhu


Abstract
Most neural abstractive summarization models are capable of producing high-quality summaries. However, they still frequently contain factual errors. Existing factuality-oriented abstractive summarization models only consider the integration of factual information and ignore the causes of factual errors. To address this issue, we propose a factuality-oriented abstractive summarization model DASum, which is based on a new task factual relation discrimination that is able to identify the causes of factual errors. First, we use data augmentation methods to construct counterfactual summaries (i. e., negative samples), and build a factual summarization dataset. Then, we propose the factual relation discrimination task, which determines the factuality of the dependency relations in summaries during summary generation and guides our DASum to generate factual relations, thereby improving the factuality of summaries. Experimental results on the CNN/DM and XSUM datasets show that our DASum outperforms several state-of-the-art benchmarks in terms of the factual metrics.
Anthology ID:
2023.findings-emnlp.69
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2023
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
977–986
Language:
URL:
https://aclanthology.org/2023.findings-emnlp.69
DOI:
10.18653/v1/2023.findings-emnlp.69
Bibkey:
Cite (ACL):
Zhiguang Gao, Peifeng Li, Feng Jiang, Xiaomin Chu, and Qiaoming Zhu. 2023. Factual Relation Discrimination for Factuality-oriented Abstractive Summarization. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 977–986, Singapore. Association for Computational Linguistics.
Cite (Informal):
Factual Relation Discrimination for Factuality-oriented Abstractive Summarization (Gao et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-emnlp.69.pdf
Video:
 https://aclanthology.org/2023.findings-emnlp.69.mp4