<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="chawla-yang-2020-semi">
    <titleInfo>
        <title>Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Kunal</namePart>
        <namePart type="family">Chawla</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Diyi</namePart>
        <namePart type="family">Yang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: EMNLP 2020</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Trevor</namePart>
            <namePart type="family">Cohn</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yulan</namePart>
            <namePart type="family">He</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yang</namePart>
            <namePart type="family">Liu</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences, which can be used to improve performance of many downstream NLP tasks. In this work, we propose a semi-supervised formality style transfer model that utilizes a language model-based discriminator to maximize the likelihood of the output sentence being formal, which allows us to use maximization of token-level conditional probabilities for training. We further propose to maximize mutual information between source and target styles as our training objective instead of maximizing the regular likelihood that often leads to repetitive and trivial generated responses. Experiments showed that our model outperformed previous state-of-the-art baselines significantly in terms of both automated metrics and human judgement. We further generalized our model to unsupervised text style transfer task, and achieved significant improvements on two benchmark sentiment style transfer datasets.</abstract>
    <identifier type="citekey">chawla-yang-2020-semi</identifier>
    <identifier type="doi">10.18653/v1/2020.findings-emnlp.212</identifier>
    <location>
        <url>https://aclanthology.org/2020.findings-emnlp.212</url>
    </location>
    <part>
        <date>2020-11</date>
        <extent unit="page">
            <start>2340</start>
            <end>2354</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization
%A Chawla, Kunal
%A Yang, Diyi
%Y Cohn, Trevor
%Y He, Yulan
%Y Liu, Yang
%S Findings of the Association for Computational Linguistics: EMNLP 2020
%D 2020
%8 November
%I Association for Computational Linguistics
%C Online
%F chawla-yang-2020-semi
%X Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences, which can be used to improve performance of many downstream NLP tasks. In this work, we propose a semi-supervised formality style transfer model that utilizes a language model-based discriminator to maximize the likelihood of the output sentence being formal, which allows us to use maximization of token-level conditional probabilities for training. We further propose to maximize mutual information between source and target styles as our training objective instead of maximizing the regular likelihood that often leads to repetitive and trivial generated responses. Experiments showed that our model outperformed previous state-of-the-art baselines significantly in terms of both automated metrics and human judgement. We further generalized our model to unsupervised text style transfer task, and achieved significant improvements on two benchmark sentiment style transfer datasets.
%R 10.18653/v1/2020.findings-emnlp.212
%U https://aclanthology.org/2020.findings-emnlp.212
%U https://doi.org/10.18653/v1/2020.findings-emnlp.212
%P 2340-2354

Markdown (Informal)

[Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization](https://aclanthology.org/2020.findings-emnlp.212) (Chawla & Yang, Findings 2020)

• Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization (Chawla & Yang, Findings 2020)

ACL

• Kunal Chawla and Diyi Yang. 2020. Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 2340–2354, Online. Association for Computational Linguistics.