Exploring Abstractive Text Summarisation for Podcasts: A Comparative Study of BART and T5 Models

Parth Saxena, Mo El-Haj


Abstract
Podcasts have become increasingly popular in recent years, resulting in a massive amount of audio content being produced every day. Efficient summarisation of podcast episodes can enable better content management and discovery for users. In this paper, we explore the use of abstractive text summarisation methods to generate high-quality summaries of podcast episodes. We use pre-trained models, BART and T5, to fine-tune on a dataset of Spotify’s 100K podcast. We evaluate our models using automated metrics and human evaluation, and find that the BART model fine-tuned on the podcast dataset achieved a higher ROUGE-1 and ROUGE-L score compared to other models, while the T5 model performed better in terms of semantic meaning. The human evaluation indicates that both models produced high-quality summaries that were well received by participants. Our study demonstrates the effectiveness of abstractive summarisation methods for podcast episodes and offers insights for improving the summarisation of audio content.
Anthology ID:
2023.ranlp-1.110
Volume:
Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
Month:
September
Year:
2023
Address:
Varna, Bulgaria
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
1023–1033
Language:
URL:
https://aclanthology.org/2023.ranlp-1.110
DOI:
Bibkey:
Cite (ACL):
Parth Saxena and Mo El-Haj. 2023. Exploring Abstractive Text Summarisation for Podcasts: A Comparative Study of BART and T5 Models. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 1023–1033, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Exploring Abstractive Text Summarisation for Podcasts: A Comparative Study of BART and T5 Models (Saxena & El-Haj, RANLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.ranlp-1.110.pdf