Exploring Neural Models for Query-Focused Summarization

Jesse Vig, Alexander Fabbri, Wojciech Kryscinski, Chien-Sheng Wu, Wenhao Liu


Abstract
Query-focused summarization (QFS) aims to produce summaries that answer particular questions of interest, enabling greater user control and personalization. While recently released datasets, such as QMSum or AQuaMuSe, facilitate research efforts in QFS, the field lacks a comprehensive study of the broad space of applicable modeling methods. In this paper we conduct a systematic exploration of neural approaches to QFS, considering two general classes of methods: two-stage extractive-abstractive solutions and end-to-end models. Within those categories, we investigate existing models and explore strategies for transfer learning. We also present two modeling extensions that achieve state-of-the-art performance on the QMSum dataset, up to a margin of 3.38 ROUGE-1, 3.72 ROUGE2, and 3.28 ROUGE-L when combined with transfer learning strategies. Results from human evaluation suggest that the best models produce more comprehensive and factually consistent summaries compared to a baseline model. Code and checkpoints are made publicly available: https://github.com/salesforce/query-focused-sum.
Anthology ID:
2022.findings-naacl.109
Volume:
Findings of the Association for Computational Linguistics: NAACL 2022
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Marine Carpuat, Marie-Catherine de Marneffe, Ivan Vladimir Meza Ruiz
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1455–1468
Language:
URL:
https://aclanthology.org/2022.findings-naacl.109
DOI:
10.18653/v1/2022.findings-naacl.109
Bibkey:
Cite (ACL):
Jesse Vig, Alexander Fabbri, Wojciech Kryscinski, Chien-Sheng Wu, and Wenhao Liu. 2022. Exploring Neural Models for Query-Focused Summarization. In Findings of the Association for Computational Linguistics: NAACL 2022, pages 1455–1468, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
Exploring Neural Models for Query-Focused Summarization (Vig et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-naacl.109.pdf
Video:
 https://aclanthology.org/2022.findings-naacl.109.mp4
Code
 salesforce/query-focused-sum