<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="de-varda-zamparelli-2022-multilingualism">
    <titleInfo>
        <title>Multilingualism Encourages Recursion: a Transfer Study with mBERT</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Andrea</namePart>
        <namePart type="family">De Varda</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Roberto</namePart>
        <namePart type="family">Zamparelli</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 4th Workshop on Research in Computational Linguistic Typology and Multilingual NLP</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Ekaterina</namePart>
            <namePart type="family">Vylomova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Edoardo</namePart>
            <namePart type="family">Ponti</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ryan</namePart>
            <namePart type="family">Cotterell</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Seattle, Washington</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>The present work constitutes an attempt to investigate the relational structures learnt by mBERT, a multilingual transformer-based network, with respect to different cross-linguistic regularities proposed in the fields of theoretical and quantitative linguistics. We pursued this objective by relying on a zero-shot transfer experiment, evaluating the model’s ability to generalize its native task to artificial languages that could either respect or violate some proposed language universal, and comparing its performance to the output of BERT, a monolingual model with an identical configuration. We created four artificial corpora through a Probabilistic Context-Free Grammar by manipulating the distribution of tokens and the structure of their dependency relations. We showed that while both models were favoured by a Zipfian distribution of the tokens and by the presence of head-dependency type structures, the multilingual transformer network exhibited a stronger reliance on hierarchical cues compared to its monolingual counterpart.</abstract>
    <identifier type="citekey">de-varda-zamparelli-2022-multilingualism</identifier>
    <identifier type="doi">10.18653/v1/2022.sigtyp-1.1</identifier>
    <location>
        <url>https://aclanthology.org/2022.sigtyp-1.1</url>
    </location>
    <part>
        <date>2022-07</date>
        <extent unit="page">
            <start>1</start>
            <end>10</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Multilingualism Encourages Recursion: a Transfer Study with mBERT
%A De Varda, Andrea
%A Zamparelli, Roberto
%Y Vylomova, Ekaterina
%Y Ponti, Edoardo
%Y Cotterell, Ryan
%S Proceedings of the 4th Workshop on Research in Computational Linguistic Typology and Multilingual NLP
%D 2022
%8 July
%I Association for Computational Linguistics
%C Seattle, Washington
%F de-varda-zamparelli-2022-multilingualism
%X The present work constitutes an attempt to investigate the relational structures learnt by mBERT, a multilingual transformer-based network, with respect to different cross-linguistic regularities proposed in the fields of theoretical and quantitative linguistics. We pursued this objective by relying on a zero-shot transfer experiment, evaluating the model’s ability to generalize its native task to artificial languages that could either respect or violate some proposed language universal, and comparing its performance to the output of BERT, a monolingual model with an identical configuration. We created four artificial corpora through a Probabilistic Context-Free Grammar by manipulating the distribution of tokens and the structure of their dependency relations. We showed that while both models were favoured by a Zipfian distribution of the tokens and by the presence of head-dependency type structures, the multilingual transformer network exhibited a stronger reliance on hierarchical cues compared to its monolingual counterpart.
%R 10.18653/v1/2022.sigtyp-1.1
%U https://aclanthology.org/2022.sigtyp-1.1
%U https://doi.org/10.18653/v1/2022.sigtyp-1.1
%P 1-10

Markdown (Informal)

[Multilingualism Encourages Recursion: a Transfer Study with mBERT](https://aclanthology.org/2022.sigtyp-1.1) (De Varda & Zamparelli, SIGTYP 2022)

• Multilingualism Encourages Recursion: a Transfer Study with mBERT (De Varda & Zamparelli, SIGTYP 2022)

ACL

• Andrea De Varda and Roberto Zamparelli. 2022. Multilingualism Encourages Recursion: a Transfer Study with mBERT. In Proceedings of the 4th Workshop on Research in Computational Linguistic Typology and Multilingual NLP, pages 1–10, Seattle, Washington. Association for Computational Linguistics.