Enhancing Factual Consistency in Text Summarization via Counterfactual Debiasing

Zhenqing Ling, Yuexiang Xie, Chenhe Dong, Ying Shen


Abstract
Despite significant progress in abstractive text summarization aimed at generating fluent and informative outputs, how to ensure the factual consistency of generated summaries remains a crucial and challenging issue. In this study, drawing inspiration from advancements in causal inference, we construct causal graphs to analyze the process of abstractive text summarization methods and identify intrinsic causes of factual inconsistency, specifically language bias and irrelevancy bias, and we propose CoFactSum, a novel framework that mitigates the causal effects of these biases through counterfactual estimation for enhancing the factual consistency of the generated content. CoFactSum provides two counterfactual estimation strategies, including Explicit Counterfactual Masking, which employs a dynamic masking approach, and Implicit Counterfactual Training, which utilizes a discriminative cross-attention mechanism. Besides, we propose a Debiasing Degree Adjustment mechanism to dynamically calibrate the level of debiasing at each decoding step. Extensive experiments conducted on two widely used summarization datasets demonstrate the effectiveness and advantages of the proposed CoFactSum in enhancing the factual consistency of generated summaries, outperforming several baseline methods.
Anthology ID:
2025.coling-main.530
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7912–7924
Language:
URL:
https://aclanthology.org/2025.coling-main.530/
DOI:
Bibkey:
Cite (ACL):
Zhenqing Ling, Yuexiang Xie, Chenhe Dong, and Ying Shen. 2025. Enhancing Factual Consistency in Text Summarization via Counterfactual Debiasing. In Proceedings of the 31st International Conference on Computational Linguistics, pages 7912–7924, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Enhancing Factual Consistency in Text Summarization via Counterfactual Debiasing (Ling et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.530.pdf