<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="severini-etal-2022-dont">
    <titleInfo>
        <title>Don’t Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Silvia</namePart>
        <namePart type="family">Severini</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Viktor</namePart>
        <namePart type="family">Hangya</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Masoud</namePart>
        <namePart type="family">Jalili Sabet</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alexander</namePart>
        <namePart type="family">Fraser</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Hinrich</namePart>
        <namePart type="family">Schütze</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the BUCC Workshop within LREC 2022</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Reinhard</namePart>
            <namePart type="family">Rapp</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Pierre</namePart>
            <namePart type="family">Zweigenbaum</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Serge</namePart>
            <namePart type="family">Sharoff</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>European Language Resources Association</publisher>
            <place>
                <placeTerm type="text">Marseille, France</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Bilingual Word Embeddings (BWEs) are one of the cornerstones of cross-lingual transfer of NLP models. They can be built using only monolingual corpora without supervision leading to numerous works focusing on unsupervised BWEs. However, most of the current approaches to build unsupervised BWEs do not compare their results with methods based on easy-to-access cross-lingual signals. In this paper, we argue that such signals should always be considered when developing unsupervised BWE methods. The two approaches we find most effective are: 1) using identical words as seed lexicons (which unsupervised approaches incorrectly assume are not available for orthographically distinct language pairs) and 2) combining such lexicons with pairs extracted by matching romanized versions of words with an edit distance threshold. We experiment on thirteen non-Latin languages (and English) and show that such cheap signals work well and that they outperform using more complex unsupervised methods on distant language pairs such as Chinese, Japanese, Kannada, Tamil, and Thai. In addition, they are even competitive with the use of high-quality lexicons in supervised approaches. Our results show that these training signals should not be neglected when building BWEs, even for distant languages.</abstract>
    <identifier type="citekey">severini-etal-2022-dont</identifier>
    <location>
        <url>https://aclanthology.org/2022.bucc-1.3</url>
    </location>
    <part>
        <date>2022-06</date>
        <extent unit="page">
            <start>15</start>
            <end>22</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Don’t Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings
%A Severini, Silvia
%A Hangya, Viktor
%A Jalili Sabet, Masoud
%A Fraser, Alexander
%A Schütze, Hinrich
%Y Rapp, Reinhard
%Y Zweigenbaum, Pierre
%Y Sharoff, Serge
%S Proceedings of the BUCC Workshop within LREC 2022
%D 2022
%8 June
%I European Language Resources Association
%C Marseille, France
%F severini-etal-2022-dont
%X Bilingual Word Embeddings (BWEs) are one of the cornerstones of cross-lingual transfer of NLP models. They can be built using only monolingual corpora without supervision leading to numerous works focusing on unsupervised BWEs. However, most of the current approaches to build unsupervised BWEs do not compare their results with methods based on easy-to-access cross-lingual signals. In this paper, we argue that such signals should always be considered when developing unsupervised BWE methods. The two approaches we find most effective are: 1) using identical words as seed lexicons (which unsupervised approaches incorrectly assume are not available for orthographically distinct language pairs) and 2) combining such lexicons with pairs extracted by matching romanized versions of words with an edit distance threshold. We experiment on thirteen non-Latin languages (and English) and show that such cheap signals work well and that they outperform using more complex unsupervised methods on distant language pairs such as Chinese, Japanese, Kannada, Tamil, and Thai. In addition, they are even competitive with the use of high-quality lexicons in supervised approaches. Our results show that these training signals should not be neglected when building BWEs, even for distant languages.
%U https://aclanthology.org/2022.bucc-1.3
%P 15-22

Markdown (Informal)

[Don’t Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings](https://aclanthology.org/2022.bucc-1.3) (Severini et al., BUCC 2022)

• Don’t Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings (Severini et al., BUCC 2022)

ACL

• Silvia Severini, Viktor Hangya, Masoud Jalili Sabet, Alexander Fraser, and Hinrich Schütze. 2022. Don’t Forget Cheap Training Signals Before Building Unsupervised Bilingual Word Embeddings. In Proceedings of the BUCC Workshop within LREC 2022, pages 15–22, Marseille, France. European Language Resources Association.