DanSumT5: Automatic Abstractive Summarization for Danish

Sara Kolding, Katrine Nymann, Ida Hansen, Kenneth Enevoldsen, Ross Kristensen-McLachlan


Abstract
Automatic abstractive text summarization is a challenging task in the field of natural language processing. This paper presents a model for domain-specific sum marization for Danish news articles, Dan SumT5; an mT5 model fine-tuned on a cleaned subset of the DaNewsroom dataset consisting of abstractive summary-article pairs. The resulting state-of-the-art model is evaluated both quantitatively and qualitatively, using ROUGE and BERTScore metrics and human rankings of the summaries. We find that although model refinements increase quantitative and qualitative performance, the model is still prone to factual errors. We discuss the limitations of current evaluation methods for automatic abstractive summarization and underline the need for improved metrics and transparency within the field. We suggest that future work should employ methods for detecting and reducing errors in model output and methods for referenceless evaluation of summaries.
Anthology ID:
2023.nodalida-1.25
Volume:
Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa)
Month:
May
Year:
2023
Address:
Tórshavn, Faroe Islands
Editors:
Tanel Alumäe, Mark Fishel
Venue:
NoDaLiDa
SIG:
Publisher:
University of Tartu Library
Note:
Pages:
248–264
Language:
URL:
https://aclanthology.org/2023.nodalida-1.25
DOI:
Bibkey:
Cite (ACL):
Sara Kolding, Katrine Nymann, Ida Hansen, Kenneth Enevoldsen, and Ross Kristensen-McLachlan. 2023. DanSumT5: Automatic Abstractive Summarization for Danish. In Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa), pages 248–264, Tórshavn, Faroe Islands. University of Tartu Library.
Cite (Informal):
DanSumT5: Automatic Abstractive Summarization for Danish (Kolding et al., NoDaLiDa 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.nodalida-1.25.pdf