Team Converge at ProbSum 2023: Abstractive Text Summarization of Patient Progress Notes

Gaurav Kolhatkar, Aditya Paranjape, Omkar Gokhale, Dipali Kadam


Abstract
In this paper, we elaborate on our approach for the shared task 1A issued by BioNLP Workshop 2023 titled Problem List Summarization. With an increase in the digitization of health records, a need arises for quick and precise summarization of large amounts of records. With the help of summarization, medical professionals can sieve through multiple records in a short span of time without overlooking any crucial point. We use abstractive text summarization for this task and experiment with multiple state-of-the-art models like Pegasus, BART, and T5, along with various pre-processing and data augmentation techniques to generate summaries from patients’ progress notes. For this task, the metric used was the ROUGE-L score. From our experiments, we conclude that Pegasus is the best-performing model on the dataset, achieving a ROUGE-L F1 score of 0.2744 on the test dataset (3rd rank on the leaderboard).
Anthology ID:
2023.bionlp-1.50
Volume:
The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Dina Demner-fushman, Sophia Ananiadou, Kevin Cohen
Venue:
BioNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
510–515
Language:
URL:
https://aclanthology.org/2023.bionlp-1.50
DOI:
10.18653/v1/2023.bionlp-1.50
Bibkey:
Cite (ACL):
Gaurav Kolhatkar, Aditya Paranjape, Omkar Gokhale, and Dipali Kadam. 2023. Team Converge at ProbSum 2023: Abstractive Text Summarization of Patient Progress Notes. In The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, pages 510–515, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Team Converge at ProbSum 2023: Abstractive Text Summarization of Patient Progress Notes (Kolhatkar et al., BioNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.bionlp-1.50.pdf
Video:
 https://aclanthology.org/2023.bionlp-1.50.mp4