<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="moradi-etal-2020-training">
    <titleInfo>
        <title>Training with Adversaries to Improve Faithfulness of Attention in Neural Machine Translation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Pooya</namePart>
        <namePart type="family">Moradi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Nishant</namePart>
        <namePart type="family">Kambhatla</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Anoop</namePart>
        <namePart type="family">Sarkar</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Boaz</namePart>
            <namePart type="family">Shmueli</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yin</namePart>
            <namePart type="given">Jou</namePart>
            <namePart type="family">Huang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Suzhou, China</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Can we trust that the attention heatmaps produced by a neural machine translation (NMT) model reflect its true internal reasoning? We isolate and examine in detail the notion of faithfulness in NMT models. We provide a measure of faithfulness for NMT based on a variety of stress tests where model parameters are perturbed and measuring faithfulness based on how often the model output changes. We show that our proposed faithfulness measure for NMT models can be improved using a novel differentiable objective that rewards faithful behaviour by the model through probability divergence. Our experimental results on multiple language pairs show that our objective function is effective in increasing faithfulness and can lead to a useful analysis of NMT model behaviour and more trustworthy attention heatmaps. Our proposed objective improves faithfulness without reducing the translation quality and it also seems to have a useful regularization effect on the NMT model and can even improve translation quality in some cases.</abstract>
    <identifier type="citekey">moradi-etal-2020-training</identifier>
    <location>
        <url>https://aclanthology.org/2020.aacl-srw.14</url>
    </location>
    <part>
        <date>2020-12</date>
        <extent unit="page">
            <start>93</start>
            <end>100</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Training with Adversaries to Improve Faithfulness of Attention in Neural Machine Translation
%A Moradi, Pooya
%A Kambhatla, Nishant
%A Sarkar, Anoop
%Y Shmueli, Boaz
%Y Huang, Yin Jou
%S Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop
%D 2020
%8 December
%I Association for Computational Linguistics
%C Suzhou, China
%F moradi-etal-2020-training
%X Can we trust that the attention heatmaps produced by a neural machine translation (NMT) model reflect its true internal reasoning? We isolate and examine in detail the notion of faithfulness in NMT models. We provide a measure of faithfulness for NMT based on a variety of stress tests where model parameters are perturbed and measuring faithfulness based on how often the model output changes. We show that our proposed faithfulness measure for NMT models can be improved using a novel differentiable objective that rewards faithful behaviour by the model through probability divergence. Our experimental results on multiple language pairs show that our objective function is effective in increasing faithfulness and can lead to a useful analysis of NMT model behaviour and more trustworthy attention heatmaps. Our proposed objective improves faithfulness without reducing the translation quality and it also seems to have a useful regularization effect on the NMT model and can even improve translation quality in some cases.
%U https://aclanthology.org/2020.aacl-srw.14
%P 93-100

Markdown (Informal)

[Training with Adversaries to Improve Faithfulness of Attention in Neural Machine Translation](https://aclanthology.org/2020.aacl-srw.14) (Moradi et al., AACL 2020)

• Training with Adversaries to Improve Faithfulness of Attention in Neural Machine Translation (Moradi et al., AACL 2020)

ACL

• Pooya Moradi, Nishant Kambhatla, and Anoop Sarkar. 2020. Training with Adversaries to Improve Faithfulness of Attention in Neural Machine Translation. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop, pages 93–100, Suzhou, China. Association for Computational Linguistics.