%0 Conference Proceedings %T Gradient-Based Adversarial Factual Consistency Evaluation for Abstractive Summarization %A Zeng, Zhiyuan %A Chen, Jiaze %A Xu, Weiran %A Li, Lei %Y Moens, Marie-Francine %Y Huang, Xuanjing %Y Specia, Lucia %Y Yih, Scott Wen-tau %S Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing %D 2021 %8 November %I Association for Computational Linguistics %C Online and Punta Cana, Dominican Republic %F zeng-etal-2021-gradient %X Neural abstractive summarization systems have gained significant progress in recent years. However, abstractive summarization often produce inconsisitent statements or false facts. How to automatically generate highly abstract yet factually correct summaries? In this paper, we proposed an efficient weak-supervised adversarial data augmentation approach to form the factual consistency dataset. Based on the artificial dataset, we train an evaluation model that can not only make accurate and robust factual consistency discrimination but is also capable of making interpretable factual errors tracing by backpropagated gradient distribution on token embeddings. Experiments and analysis conduct on public annotated summarization and factual consistency datasets demonstrate our approach effective and reasonable. %R 10.18653/v1/2021.emnlp-main.337 %U https://aclanthology.org/2021.emnlp-main.337 %U https://doi.org/10.18653/v1/2021.emnlp-main.337 %P 4102-4108