<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="feng-etal-2022-hierarchical">
    <titleInfo>
        <title>Hierarchical Inductive Transfer for Continual Dialogue Learning</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Shaoxiong</namePart>
        <namePart type="family">Feng</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Xuancheng</namePart>
        <namePart type="family">Ren</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kan</namePart>
        <namePart type="family">Li</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Xu</namePart>
        <namePart type="family">Sun</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: ACL 2022</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Dublin, Ireland</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Pre-trained models have achieved excellent performance on the dialogue task. However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of the dialogue system on the embedded devices but also causes knowledge forgetting on pre-trained models and knowledge interference among diverse dialogue tasks. In this work, we propose a hierarchical inductive transfer framework to learn and deploy the dialogue skills continually and efficiently. First, we introduce the adapter module into pre-trained models for learning new dialogue tasks. As the only trainable module, it is beneficial for the dialogue system on the embedded devices to acquire new dialogue skills with negligible additional parameters. Then, for alleviating knowledge interference between tasks yet benefiting the regularization between them, we further design hierarchical inductive transfer that enables new tasks to use general knowledge in the base adapter without being misled by diverse knowledge in task-specific adapters. Empirical evaluation and analysis indicate that our framework obtains comparable performance under deployment-friendly model capacity.</abstract>
    <identifier type="citekey">feng-etal-2022-hierarchical</identifier>
    <identifier type="doi">10.18653/v1/2022.findings-acl.57</identifier>
    <location>
        <url>https://aclanthology.org/2022.findings-acl.57</url>
    </location>
    <part>
        <date>2022-05</date>
        <extent unit="page">
            <start>693</start>
            <end>699</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Hierarchical Inductive Transfer for Continual Dialogue Learning
%A Feng, Shaoxiong
%A Ren, Xuancheng
%A Li, Kan
%A Sun, Xu
%S Findings of the Association for Computational Linguistics: ACL 2022
%D 2022
%8 May
%I Association for Computational Linguistics
%C Dublin, Ireland
%F feng-etal-2022-hierarchical
%X Pre-trained models have achieved excellent performance on the dialogue task. However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of the dialogue system on the embedded devices but also causes knowledge forgetting on pre-trained models and knowledge interference among diverse dialogue tasks. In this work, we propose a hierarchical inductive transfer framework to learn and deploy the dialogue skills continually and efficiently. First, we introduce the adapter module into pre-trained models for learning new dialogue tasks. As the only trainable module, it is beneficial for the dialogue system on the embedded devices to acquire new dialogue skills with negligible additional parameters. Then, for alleviating knowledge interference between tasks yet benefiting the regularization between them, we further design hierarchical inductive transfer that enables new tasks to use general knowledge in the base adapter without being misled by diverse knowledge in task-specific adapters. Empirical evaluation and analysis indicate that our framework obtains comparable performance under deployment-friendly model capacity.
%R 10.18653/v1/2022.findings-acl.57
%U https://aclanthology.org/2022.findings-acl.57
%U https://doi.org/10.18653/v1/2022.findings-acl.57
%P 693-699

Markdown (Informal)

[Hierarchical Inductive Transfer for Continual Dialogue Learning](https://aclanthology.org/2022.findings-acl.57) (Feng et al., Findings 2022)

• Hierarchical Inductive Transfer for Continual Dialogue Learning (Feng et al., Findings 2022)

ACL

• Shaoxiong Feng, Xuancheng Ren, Kan Li, and Xu Sun. 2022. Hierarchical Inductive Transfer for Continual Dialogue Learning. In Findings of the Association for Computational Linguistics: ACL 2022, pages 693–699, Dublin, Ireland. Association for Computational Linguistics.