Language Identification and Analysis of Code-Switched Social Media Text

Deepthi Mave; Suraj Maharjan; Thamar Solorio

doi:10.18653/v1/W18-3206

Language Identification and Analysis of Code-Switched Social Media Text

Deepthi Mave, Suraj Maharjan, Thamar Solorio

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

In this paper, we detail our work on comparing different word-level language identification systems for code-switched Hindi-English data and a standard Spanish-English dataset. In this regard, we build a new code-switched dataset for Hindi-English. To understand the code-switching patterns in these language pairs, we investigate different code-switching metrics. We find that the CRF model outperforms the neural network based models by a margin of 2-5 percentage points for Spanish-English and 3-5 percentage points for Hindi-English.

Anthology ID:: W18-3206
Volume:: Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching
Month:: July
Year:: 2018
Address:: Melbourne, Australia
Editors:: Gustavo Aguilar, Fahad AlGhamdi, Victor Soto, Thamar Solorio, Mona Diab, Julia Hirschberg
Venue:: ACL
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 51–61
Language:
URL:: https://aclanthology.org/W18-3206/
DOI:: 10.18653/v1/W18-3206
Bibkey:
Cite (ACL):: Deepthi Mave, Suraj Maharjan, and Thamar Solorio. 2018. Language Identification and Analysis of Code-Switched Social Media Text. In Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching, pages 51–61, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):: Language Identification and Analysis of Code-Switched Social Media Text (Mave et al., ACL 2018)
Copy Citation:
PDF:: https://aclanthology.org/W18-3206.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{mave-etal-2018-language,
    title = "Language Identification and Analysis of Code-Switched Social Media Text",
    author = "Mave, Deepthi  and
      Maharjan, Suraj  and
      Solorio, Thamar",
    editor = "Aguilar, Gustavo  and
      AlGhamdi, Fahad  and
      Soto, Victor  and
      Solorio, Thamar  and
      Diab, Mona  and
      Hirschberg, Julia",
    booktitle = "Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching",
    month = jul,
    year = "2018",
    address = "Melbourne, Australia",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/W18-3206/",
    doi = "10.18653/v1/W18-3206",
    pages = "51--61",
    abstract = "In this paper, we detail our work on comparing different word-level language identification systems for code-switched Hindi-English data and a standard Spanish-English dataset. In this regard, we build a new code-switched dataset for Hindi-English. To understand the code-switching patterns in these language pairs, we investigate different code-switching metrics. We find that the CRF model outperforms the neural network based models by a margin of 2-5 percentage points for Spanish-English and 3-5 percentage points for Hindi-English."
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="mave-etal-2018-language">
    <titleInfo>
        <title>Language Identification and Analysis of Code-Switched Social Media Text</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Deepthi</namePart>
        <namePart type="family">Mave</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Suraj</namePart>
        <namePart type="family">Maharjan</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Thamar</namePart>
        <namePart type="family">Solorio</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2018-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Gustavo</namePart>
            <namePart type="family">Aguilar</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Fahad</namePart>
            <namePart type="family">AlGhamdi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Victor</namePart>
            <namePart type="family">Soto</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Thamar</namePart>
            <namePart type="family">Solorio</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Mona</namePart>
            <namePart type="family">Diab</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Julia</namePart>
            <namePart type="family">Hirschberg</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Melbourne, Australia</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper, we detail our work on comparing different word-level language identification systems for code-switched Hindi-English data and a standard Spanish-English dataset. In this regard, we build a new code-switched dataset for Hindi-English. To understand the code-switching patterns in these language pairs, we investigate different code-switching metrics. We find that the CRF model outperforms the neural network based models by a margin of 2-5 percentage points for Spanish-English and 3-5 percentage points for Hindi-English.</abstract>
    <identifier type="citekey">mave-etal-2018-language</identifier>
    <identifier type="doi">10.18653/v1/W18-3206</identifier>
    <location>
        <url>https://aclanthology.org/W18-3206/</url>
    </location>
    <part>
        <date>2018-07</date>
        <extent unit="page">
            <start>51</start>
            <end>61</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T Language Identification and Analysis of Code-Switched Social Media Text
%A Mave, Deepthi
%A Maharjan, Suraj
%A Solorio, Thamar
%Y Aguilar, Gustavo
%Y AlGhamdi, Fahad
%Y Soto, Victor
%Y Solorio, Thamar
%Y Diab, Mona
%Y Hirschberg, Julia
%S Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching
%D 2018
%8 July
%I Association for Computational Linguistics
%C Melbourne, Australia
%F mave-etal-2018-language
%X In this paper, we detail our work on comparing different word-level language identification systems for code-switched Hindi-English data and a standard Spanish-English dataset. In this regard, we build a new code-switched dataset for Hindi-English. To understand the code-switching patterns in these language pairs, we investigate different code-switching metrics. We find that the CRF model outperforms the neural network based models by a margin of 2-5 percentage points for Spanish-English and 3-5 percentage points for Hindi-English.
%R 10.18653/v1/W18-3206
%U https://aclanthology.org/W18-3206/
%U https://doi.org/10.18653/v1/W18-3206
%P 51-61

Download as File

Markdown (Informal)

[Language Identification and Analysis of Code-Switched Social Media Text](https://aclanthology.org/W18-3206/) (Mave et al., ACL 2018)

Language Identification and Analysis of Code-Switched Social Media Text (Mave et al., ACL 2018)

ACL

Deepthi Mave, Suraj Maharjan, and Thamar Solorio. 2018. Language Identification and Analysis of Code-Switched Social Media Text. In Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching, pages 51–61, Melbourne, Australia. Association for Computational Linguistics.