Event-Keyed Summarization

William Gantt, Alexander Martin, Pavlo Kuchmiichuk, Aaron White


Abstract
We introduce *event-keyed summarization* (EKS), a novel task that marries traditional summarization and document-level event extraction, with the goal of generating a contextualized summary for a specific event, given a document and an extracted event structure. We introduce a dataset for this task, MUCSUM, consisting of summaries of all events in the classic MUC-4 dataset, along with a set of baselines that comprises both pretrained LM standards in the summarization literature, as well as larger frontier models. We show that ablations that reduce EKS to traditional summarization or structure-to-text yield inferior summaries of target events and that MUCSUM is a robust benchmark for this task. Lastly, we conduct a human evaluation of both reference and model summaries, and provide some detailed analysis of the results.
Anthology ID:
2024.findings-emnlp.431
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7333–7345
Language:
URL:
https://aclanthology.org/2024.findings-emnlp.431
DOI:
Bibkey:
Cite (ACL):
William Gantt, Alexander Martin, Pavlo Kuchmiichuk, and Aaron White. 2024. Event-Keyed Summarization. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 7333–7345, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Event-Keyed Summarization (Gantt et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-emnlp.431.pdf
Data:
 2024.findings-emnlp.431.data.zip