GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly Reviews

Maxime Darrin, Ines Arous, Pablo Piantanida, Jackie Cheung


Abstract
Scientific peer review is essential for the quality of academic publications. However, the increasing number of paper submissions to conferences has strained the reviewing process. This surge poses a burden on area chairs who have to carefully read an ever-growing volume of reviews and discern each reviewer’s main arguments as part of their decision process. In this paper, we introduce , a summarization method designed to offer a concise yet comprehensive overview of scholarly reviews. Unlike traditional consensus-based methods, extracts both common and unique opinions from the reviews. We introduce novel uniqueness scores based on the Rational Speech Act framework to identify relevant sentences in the reviews. Our method aims to provide a pragmatic glimpse into all reviews, offering a balanced perspective on their opinions. Our experimental results with both automatic metrics and human evaluation show that generates more discriminative summaries than baseline methods in terms of human evaluation while achieving comparable performance with these methods in terms of automatic metrics.
Anthology ID:
2024.acl-long.688
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12737–12752
Language:
URL:
https://aclanthology.org/2024.acl-long.688
DOI:
Bibkey:
Cite (ACL):
Maxime Darrin, Ines Arous, Pablo Piantanida, and Jackie Cheung. 2024. GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly Reviews. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12737–12752, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
GLIMPSE: Pragmatically Informative Multi-Document Summarization for Scholarly Reviews (Darrin et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.688.pdf