<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="turbitt-etal-2023-mdc">
    <titleInfo>
        <title>MDC at BioLaySumm Task 1: Evaluating GPT Models for Biomedical Lay Summarization</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Oisín</namePart>
        <namePart type="family">Turbitt</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Robert</namePart>
        <namePart type="family">Bevan</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mouhamad</namePart>
        <namePart type="family">Aboshokor</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Dina</namePart>
            <namePart type="family">Demner-fushman</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sophia</namePart>
            <namePart type="family">Ananiadou</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Kevin</namePart>
            <namePart type="family">Cohen</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Toronto, Canada</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper presents our approach to the BioLaySumm Task 1 shared task, held at the BioNLP 2023 Workshop. The effective communication of scientific knowledge to the general public is often limited by the technical language used in research, making it difficult for non-experts to comprehend. To address this issue, lay summaries can be used to explain research findings to non-experts in an accessible form. We conduct an evaluation of autoregressive language models, both general and specialized for the biomedical domain, to generate lay summaries from biomedical research article abstracts. Our findings demonstrate that a GPT-3.5 model combined with a straightforward few-shot prompt produces lay summaries that achieve significantly relevance and factuality compared to those generated by a fine-tuned BioGPT model. However, the summaries generated by the BioGPT model exhibit better readability. Notably, our submission for the shared task achieved 1st place in the competition.</abstract>
    <identifier type="citekey">turbitt-etal-2023-mdc</identifier>
    <identifier type="doi">10.18653/v1/2023.bionlp-1.65</identifier>
    <location>
        <url>https://aclanthology.org/2023.bionlp-1.65/</url>
    </location>
    <part>
        <date>2023-07</date>
        <extent unit="page">
            <start>611</start>
            <end>619</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T MDC at BioLaySumm Task 1: Evaluating GPT Models for Biomedical Lay Summarization
%A Turbitt, Oisín
%A Bevan, Robert
%A Aboshokor, Mouhamad
%Y Demner-fushman, Dina
%Y Ananiadou, Sophia
%Y Cohen, Kevin
%S The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada
%F turbitt-etal-2023-mdc
%X This paper presents our approach to the BioLaySumm Task 1 shared task, held at the BioNLP 2023 Workshop. The effective communication of scientific knowledge to the general public is often limited by the technical language used in research, making it difficult for non-experts to comprehend. To address this issue, lay summaries can be used to explain research findings to non-experts in an accessible form. We conduct an evaluation of autoregressive language models, both general and specialized for the biomedical domain, to generate lay summaries from biomedical research article abstracts. Our findings demonstrate that a GPT-3.5 model combined with a straightforward few-shot prompt produces lay summaries that achieve significantly relevance and factuality compared to those generated by a fine-tuned BioGPT model. However, the summaries generated by the BioGPT model exhibit better readability. Notably, our submission for the shared task achieved 1st place in the competition.
%R 10.18653/v1/2023.bionlp-1.65
%U https://aclanthology.org/2023.bionlp-1.65/
%U https://doi.org/10.18653/v1/2023.bionlp-1.65
%P 611-619

Markdown (Informal)

[MDC at BioLaySumm Task 1: Evaluating GPT Models for Biomedical Lay Summarization](https://aclanthology.org/2023.bionlp-1.65/) (Turbitt et al., BioNLP 2023)

• MDC at BioLaySumm Task 1: Evaluating GPT Models for Biomedical Lay Summarization (Turbitt et al., BioNLP 2023)

ACL

• Oisín Turbitt, Robert Bevan, and Mouhamad Aboshokor. 2023. MDC at BioLaySumm Task 1: Evaluating GPT Models for Biomedical Lay Summarization. In The 22nd Workshop on Biomedical Natural Language Processing and BioNLP Shared Tasks, pages 611–619, Toronto, Canada. Association for Computational Linguistics.