<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="shenoy-etal-2021-asr">
    <titleInfo>
        <title>ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ashish</namePart>
        <namePart type="family">Shenoy</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sravan</namePart>
        <namePart type="family">Bodapati</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Katrin</namePart>
        <namePart type="family">Kirchhoff</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-08</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 4th Workshop on e-Commerce and NLP</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Shervin</namePart>
            <namePart type="family">Malmasi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Surya</namePart>
            <namePart type="family">Kallumadi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Nicola</namePart>
            <namePart type="family">Ueffing</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Oleg</namePart>
            <namePart type="family">Rokhlenko</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Eugene</namePart>
            <namePart type="family">Agichtein</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ido</namePart>
            <namePart type="family">Guy</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Automatic Speech Recognition (ASR) robustness toward slot entities are critical in e-commerce voice assistants that involve monetary transactions and purchases. Along with effective domain adaptation, it is intuitive that cross utterance contextual cues play an important role in disambiguating domain specific content words from speech. In this paper, we investigate various techniques to improve contextualization, content word robustness and domain adaptation of a Transformer-XL neural language model (NLM) to rescore ASR N-best hypotheses. To improve contextualization, we utilize turn level dialogue acts along with cross utterance context carry over. Additionally, to adapt our domain-general NLM towards e-commerce on-the-fly, we use embeddings derived from a finetuned masked LM on in-domain data. Finally, to improve robustness towards in-domain content words, we propose a multi-task model that can jointly perform content word detection and language modeling tasks. Compared to a non-contextual LSTM LM baseline, our best performing NLM rescorer results in a content WER reduction of 19.2% on e-commerce audio test set and a slot labeling F1 improvement of 6.4%.</abstract>
    <identifier type="citekey">shenoy-etal-2021-asr</identifier>
    <identifier type="doi">10.18653/v1/2021.ecnlp-1.3</identifier>
    <location>
        <url>https://aclanthology.org/2021.ecnlp-1.3</url>
    </location>
    <part>
        <date>2021-08</date>
        <extent unit="page">
            <start>18</start>
            <end>25</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling
%A Shenoy, Ashish
%A Bodapati, Sravan
%A Kirchhoff, Katrin
%Y Malmasi, Shervin
%Y Kallumadi, Surya
%Y Ueffing, Nicola
%Y Rokhlenko, Oleg
%Y Agichtein, Eugene
%Y Guy, Ido
%S Proceedings of the 4th Workshop on e-Commerce and NLP
%D 2021
%8 August
%I Association for Computational Linguistics
%C Online
%F shenoy-etal-2021-asr
%X Automatic Speech Recognition (ASR) robustness toward slot entities are critical in e-commerce voice assistants that involve monetary transactions and purchases. Along with effective domain adaptation, it is intuitive that cross utterance contextual cues play an important role in disambiguating domain specific content words from speech. In this paper, we investigate various techniques to improve contextualization, content word robustness and domain adaptation of a Transformer-XL neural language model (NLM) to rescore ASR N-best hypotheses. To improve contextualization, we utilize turn level dialogue acts along with cross utterance context carry over. Additionally, to adapt our domain-general NLM towards e-commerce on-the-fly, we use embeddings derived from a finetuned masked LM on in-domain data. Finally, to improve robustness towards in-domain content words, we propose a multi-task model that can jointly perform content word detection and language modeling tasks. Compared to a non-contextual LSTM LM baseline, our best performing NLM rescorer results in a content WER reduction of 19.2% on e-commerce audio test set and a slot labeling F1 improvement of 6.4%.
%R 10.18653/v1/2021.ecnlp-1.3
%U https://aclanthology.org/2021.ecnlp-1.3
%U https://doi.org/10.18653/v1/2021.ecnlp-1.3
%P 18-25

Markdown (Informal)

[ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling](https://aclanthology.org/2021.ecnlp-1.3) (Shenoy et al., ECNLP 2021)

• ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling (Shenoy et al., ECNLP 2021)

ACL

• Ashish Shenoy, Sravan Bodapati, and Katrin Kirchhoff. 2021. ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling. In Proceedings of the 4th Workshop on e-Commerce and NLP, pages 18–25, Online. Association for Computational Linguistics.