<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="sheikh-etal-2022-transformer">
    <titleInfo>
        <title>Transformer versus LSTM Language Models trained on Uncertain ASR Hypotheses in Limited Data Scenarios</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Imran</namePart>
        <namePart type="family">Sheikh</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Emmanuel</namePart>
        <namePart type="family">Vincent</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Irina</namePart>
        <namePart type="family">Illina</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Thirteenth Language Resources and Evaluation Conference</title>
        </titleInfo>
        <originInfo>
            <publisher>European Language Resources Association</publisher>
            <place>
                <placeTerm type="text">Marseille, France</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In several ASR use cases, training and adaptation of domain-specific LMs can only rely on a small amount of manually verified text transcriptions and sometimes a limited amount of in-domain speech. Training of LSTM LMs in such limited data scenarios can benefit from alternate uncertain ASR hypotheses, as observed in our recent work. In this paper, we propose a method to train Transformer LMs on ASR confusion networks. We evaluate whether these self-attention based LMs are better at exploiting alternate ASR hypotheses as compared to LSTM LMs. Evaluation results show that Transformer LMs achieve 3-6% relative reduction in perplexity on the AMI scenario meetings but perform similar to LSTM LMs on the smaller Verbmobil conversational corpus. Evaluation on ASR N-best rescoring shows that LSTM and Transformer LMs trained on ASR confusion networks do not bring significant WER reductions. However, a qualitative analysis reveals that they are better at predicting less frequent words.</abstract>
    <identifier type="citekey">sheikh-etal-2022-transformer</identifier>
    <location>
        <url>https://aclanthology.org/2022.lrec-1.41</url>
    </location>
    <part>
        <date>2022-06</date>
        <extent unit="page">
            <start>393</start>
            <end>399</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Transformer versus LSTM Language Models trained on Uncertain ASR Hypotheses in Limited Data Scenarios
%A Sheikh, Imran
%A Vincent, Emmanuel
%A Illina, Irina
%S Proceedings of the Thirteenth Language Resources and Evaluation Conference
%D 2022
%8 June
%I European Language Resources Association
%C Marseille, France
%F sheikh-etal-2022-transformer
%X In several ASR use cases, training and adaptation of domain-specific LMs can only rely on a small amount of manually verified text transcriptions and sometimes a limited amount of in-domain speech. Training of LSTM LMs in such limited data scenarios can benefit from alternate uncertain ASR hypotheses, as observed in our recent work. In this paper, we propose a method to train Transformer LMs on ASR confusion networks. We evaluate whether these self-attention based LMs are better at exploiting alternate ASR hypotheses as compared to LSTM LMs. Evaluation results show that Transformer LMs achieve 3-6% relative reduction in perplexity on the AMI scenario meetings but perform similar to LSTM LMs on the smaller Verbmobil conversational corpus. Evaluation on ASR N-best rescoring shows that LSTM and Transformer LMs trained on ASR confusion networks do not bring significant WER reductions. However, a qualitative analysis reveals that they are better at predicting less frequent words.
%U https://aclanthology.org/2022.lrec-1.41
%P 393-399

Markdown (Informal)

[Transformer versus LSTM Language Models trained on Uncertain ASR Hypotheses in Limited Data Scenarios](https://aclanthology.org/2022.lrec-1.41) (Sheikh et al., LREC 2022)

• Transformer versus LSTM Language Models trained on Uncertain ASR Hypotheses in Limited Data Scenarios (Sheikh et al., LREC 2022)

ACL

• Imran Sheikh, Emmanuel Vincent, and Irina Illina. 2022. Transformer versus LSTM Language Models trained on Uncertain ASR Hypotheses in Limited Data Scenarios. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 393–399, Marseille, France. European Language Resources Association.