<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="nair-etal-2023-domain">
    <titleInfo>
        <title>Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Pranav</namePart>
        <namePart type="family">Nair</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sukomal</namePart>
        <namePart type="family">Pal</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Pradeepika</namePart>
        <namePart type="family">Verma</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: ACL 2023</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Anna</namePart>
            <namePart type="family">Rogers</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jordan</namePart>
            <namePart type="family">Boyd-Graber</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Naoaki</namePart>
            <namePart type="family">Okazaki</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Toronto, Canada</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Domain generalization is hitherto an underexplored area applied in abstractive summarization. Moreover, most existing works on domain generalization have sophisticated training algorithms. In this paper, we propose a lightweight, weight averaging based, Domain Aligned Prefix Averaging approach to domain generalization for abstractive summarization. Given a number of source domains, our method first trains a prefix for each one of them. These source prefixes generate summaries for a small number of target domain documents. The similarity of the generated summaries to their corresponding source documents is used for calculating weights required to average source prefixes. In DAPA, prefix tuning allows for lightweight finetuning, and weight averaging allows for the computationally efficient addition of new source domains. When evaluated on four diverse summarization domains, DAPA shows comparable or better performance against the baselines demonstrating the effectiveness of its prefix averaging scheme.</abstract>
    <identifier type="citekey">nair-etal-2023-domain</identifier>
    <identifier type="doi">10.18653/v1/2023.findings-acl.288</identifier>
    <location>
        <url>https://aclanthology.org/2023.findings-acl.288</url>
    </location>
    <part>
        <date>2023-07</date>
        <extent unit="page">
            <start>4696</start>
            <end>4710</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization
%A Nair, Pranav
%A Pal, Sukomal
%A Verma, Pradeepika
%Y Rogers, Anna
%Y Boyd-Graber, Jordan
%Y Okazaki, Naoaki
%S Findings of the Association for Computational Linguistics: ACL 2023
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada
%F nair-etal-2023-domain
%X Domain generalization is hitherto an underexplored area applied in abstractive summarization. Moreover, most existing works on domain generalization have sophisticated training algorithms. In this paper, we propose a lightweight, weight averaging based, Domain Aligned Prefix Averaging approach to domain generalization for abstractive summarization. Given a number of source domains, our method first trains a prefix for each one of them. These source prefixes generate summaries for a small number of target domain documents. The similarity of the generated summaries to their corresponding source documents is used for calculating weights required to average source prefixes. In DAPA, prefix tuning allows for lightweight finetuning, and weight averaging allows for the computationally efficient addition of new source domains. When evaluated on four diverse summarization domains, DAPA shows comparable or better performance against the baselines demonstrating the effectiveness of its prefix averaging scheme.
%R 10.18653/v1/2023.findings-acl.288
%U https://aclanthology.org/2023.findings-acl.288
%U https://doi.org/10.18653/v1/2023.findings-acl.288
%P 4696-4710

Markdown (Informal)

[Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization](https://aclanthology.org/2023.findings-acl.288) (Nair et al., Findings 2023)

• Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization (Nair et al., Findings 2023)

ACL

• Pranav Nair, Sukomal Pal, and Pradeepika Verma. 2023. Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization. In Findings of the Association for Computational Linguistics: ACL 2023, pages 4696–4710, Toronto, Canada. Association for Computational Linguistics.