Summarization of Opinionated Political Documents with Varied Perspectives

Nicholas Deas, Kathleen McKeown


Abstract
Global partisan hostility and polarization has increased, and this polarization is heightened around presidential elections. Models capable of generating accurate summaries of diverse perspectives can help reduce such polarization by exposing users to alternative perspectives. In this work, we introduce a novel dataset and task for independently summarizing each political perspective in a set of passages from opinionated news articles. For this task, we propose a framework for evaluating different dimensions of perspective summary performance. We benchmark 11 summarization models and LLMs of varying sizes and architectures through both automatic and human evaluation. While recent models like GPT-4o perform well on this task, we find that all models struggle to generate summaries that are faithful to the intended perspective. Our analysis of summaries focuses on how extraction behavior is impacted by features of the input documents.
Anthology ID:
2025.coling-main.539
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8088–8108
Language:
URL:
https://aclanthology.org/2025.coling-main.539/
DOI:
Bibkey:
Cite (ACL):
Nicholas Deas and Kathleen McKeown. 2025. Summarization of Opinionated Political Documents with Varied Perspectives. In Proceedings of the 31st International Conference on Computational Linguistics, pages 8088–8108, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Summarization of Opinionated Political Documents with Varied Perspectives (Deas & McKeown, COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.539.pdf