ArgSum-X: A Structure-Aware Benchmark for Argument Summarization and Key Point Analysis

Zhiqiang Shi, Oana Cocarascu


Abstract
Argument summarization requires capturing semantic content while preserving the underlying argumentative structure. We present ArgSum-X, a dataset supporting both argumentative text summarization (ATS) and key point analysis (KPA) . To construct the dataset, we propose constructed via a multi-stage annotation framework with hybrid LLM–human annotation and quality tiers, and provide a detailed analysis of annotation quality. We propose a comprehensive evaluation framework for argument summarization covering structural, faithfulness, and semantic aspects, and conduct an empirical analysis of structure-aware modeling, revealing the unique properties and challenges of argument summarization.
Anthology ID:
2026.emnlp-main.403
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9263–9309
Language:
URL:
https://aclanthology.org/2026.emnlp-main.403/
DOI:
Bibkey:
Cite (ACL):
Zhiqiang Shi and Oana Cocarascu. 2026. ArgSum-X: A Structure-Aware Benchmark for Argument Summarization and Key Point Analysis. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 9263–9309, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ArgSum-X: A Structure-Aware Benchmark for Argument Summarization and Key Point Analysis (Shi & Cocarascu, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.403.pdf