<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="mathur-etal-2023-summqa">
    <titleInfo>
        <title>SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Yash</namePart>
        <namePart type="family">Mathur</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sanketh</namePart>
        <namePart type="family">Rangreji</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Raghav</namePart>
        <namePart type="family">Kapoor</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Medha</namePart>
        <namePart type="family">Palavalli</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Amanda</namePart>
        <namePart type="family">Bertsch</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Matthew</namePart>
        <namePart type="family">Gormley</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 5th Clinical Natural Language Processing Workshop</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Tristan</namePart>
            <namePart type="family">Naumann</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Asma</namePart>
            <namePart type="family">Ben Abacha</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Steven</namePart>
            <namePart type="family">Bethard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Kirk</namePart>
            <namePart type="family">Roberts</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Anna</namePart>
            <namePart type="family">Rumshisky</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Toronto, Canada</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Medical dialogue summarization is challenging due to the unstructured nature of medical conversations, the use of medical terminologyin gold summaries, and the need to identify key information across multiple symptom sets. We present a novel system for the Dialogue2Note Medical Summarization tasks in the MEDIQA 2023 Shared Task. Our approach for sectionwise summarization (Task A) is a two-stage process of selecting semantically similar dialogues and using the top-k similar dialogues as in-context examples for GPT-4. For full-note summarization (Task B), we use a similar solution with k=1. We achieved 3rd place in Task A (2nd among all teams), 4th place in Task B Division Wise Summarization (2nd among all teams), 15th place in Task A Section Header Classification (9th among all teams), and 8th place among all teams in Task B. Our results highlight the effectiveness of few-shot prompting for this task, though we also identify several weaknesses of prompting-based approaches. We compare GPT-4 performance with several finetuned baselines. We find that GPT-4 summaries are more abstractive and shorter. We make our code publicly available.</abstract>
    <identifier type="citekey">mathur-etal-2023-summqa</identifier>
    <identifier type="doi">10.18653/v1/2023.clinicalnlp-1.51</identifier>
    <location>
        <url>https://aclanthology.org/2023.clinicalnlp-1.51</url>
    </location>
    <part>
        <date>2023-07</date>
        <extent unit="page">
            <start>490</start>
            <end>502</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization
%A Mathur, Yash
%A Rangreji, Sanketh
%A Kapoor, Raghav
%A Palavalli, Medha
%A Bertsch, Amanda
%A Gormley, Matthew
%Y Naumann, Tristan
%Y Ben Abacha, Asma
%Y Bethard, Steven
%Y Roberts, Kirk
%Y Rumshisky, Anna
%S Proceedings of the 5th Clinical Natural Language Processing Workshop
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada
%F mathur-etal-2023-summqa
%X Medical dialogue summarization is challenging due to the unstructured nature of medical conversations, the use of medical terminologyin gold summaries, and the need to identify key information across multiple symptom sets. We present a novel system for the Dialogue2Note Medical Summarization tasks in the MEDIQA 2023 Shared Task. Our approach for sectionwise summarization (Task A) is a two-stage process of selecting semantically similar dialogues and using the top-k similar dialogues as in-context examples for GPT-4. For full-note summarization (Task B), we use a similar solution with k=1. We achieved 3rd place in Task A (2nd among all teams), 4th place in Task B Division Wise Summarization (2nd among all teams), 15th place in Task A Section Header Classification (9th among all teams), and 8th place among all teams in Task B. Our results highlight the effectiveness of few-shot prompting for this task, though we also identify several weaknesses of prompting-based approaches. We compare GPT-4 performance with several finetuned baselines. We find that GPT-4 summaries are more abstractive and shorter. We make our code publicly available.
%R 10.18653/v1/2023.clinicalnlp-1.51
%U https://aclanthology.org/2023.clinicalnlp-1.51
%U https://doi.org/10.18653/v1/2023.clinicalnlp-1.51
%P 490-502

Markdown (Informal)

[SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization](https://aclanthology.org/2023.clinicalnlp-1.51) (Mathur et al., ClinicalNLP 2023)

• SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization (Mathur et al., ClinicalNLP 2023)

ACL

• Yash Mathur, Sanketh Rangreji, Raghav Kapoor, Medha Palavalli, Amanda Bertsch, and Matthew Gormley. 2023. SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization. In Proceedings of the 5th Clinical Natural Language Processing Workshop, pages 490–502, Toronto, Canada. Association for Computational Linguistics.