<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="jain-etal-2023-language">
    <titleInfo>
        <title>Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Aditi</namePart>
        <namePart type="family">Jain</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Nishant</namePart>
        <namePart type="family">Kambhatla</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Anoop</namePart>
        <namePart type="family">Sarkar</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Elizabeth</namePart>
            <namePart type="family">Salesky</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Marcello</namePart>
            <namePart type="family">Federico</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Marine</namePart>
            <namePart type="family">Carpuat</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Toronto, Canada (in-person and online)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>The decoder in simultaneous neural machine translation receives limited information from the source while having to balance the opposing requirements of latency versus translation quality. In this paper, we use an auxiliary target-side language model to augment the training of the decoder model. Under this notion of target adaptive training, generating rare or difficult tokens is rewarded which improves the translation quality while reducing latency. The predictions made by a language model in the decoder are combined with the traditional cross entropy loss which frees up the focus on the source side context. Our experimental results over multiple language pairs show that compared to previous state of the art methods in simultaneous translation, we can use an augmented target side context to improve BLEU scores significantly. We show improvements over the state of the art in the low latency range with lower average lagging values (faster output).</abstract>
    <identifier type="citekey">jain-etal-2023-language</identifier>
    <identifier type="doi">10.18653/v1/2023.iwslt-1.32</identifier>
    <location>
        <url>https://aclanthology.org/2023.iwslt-1.32</url>
    </location>
    <part>
        <date>2023-07</date>
        <extent unit="page">
            <start>341</start>
            <end>356</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation
%A Jain, Aditi
%A Kambhatla, Nishant
%A Sarkar, Anoop
%Y Salesky, Elizabeth
%Y Federico, Marcello
%Y Carpuat, Marine
%S Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023)
%D 2023
%8 July
%I Association for Computational Linguistics
%C Toronto, Canada (in-person and online)
%F jain-etal-2023-language
%X The decoder in simultaneous neural machine translation receives limited information from the source while having to balance the opposing requirements of latency versus translation quality. In this paper, we use an auxiliary target-side language model to augment the training of the decoder model. Under this notion of target adaptive training, generating rare or difficult tokens is rewarded which improves the translation quality while reducing latency. The predictions made by a language model in the decoder are combined with the traditional cross entropy loss which frees up the focus on the source side context. Our experimental results over multiple language pairs show that compared to previous state of the art methods in simultaneous translation, we can use an augmented target side context to improve BLEU scores significantly. We show improvements over the state of the art in the low latency range with lower average lagging values (faster output).
%R 10.18653/v1/2023.iwslt-1.32
%U https://aclanthology.org/2023.iwslt-1.32
%U https://doi.org/10.18653/v1/2023.iwslt-1.32
%P 341-356

Markdown (Informal)

[Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation](https://aclanthology.org/2023.iwslt-1.32) (Jain et al., IWSLT 2023)

• Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation (Jain et al., IWSLT 2023)

ACL

• Aditi Jain, Nishant Kambhatla, and Anoop Sarkar. 2023. Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation. In Proceedings of the 20th International Conference on Spoken Language Translation (IWSLT 2023), pages 341–356, Toronto, Canada (in-person and online). Association for Computational Linguistics.