<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="gurnani-2017-hypothesis">
    <titleInfo>
        <title>Hypothesis Testing based Intrinsic Evaluation of Word Embeddings</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Nishant</namePart>
        <namePart type="family">Gurnani</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2017-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Samuel</namePart>
            <namePart type="family">Bowman</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yoav</namePart>
            <namePart type="family">Goldberg</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Felix</namePart>
            <namePart type="family">Hill</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Angeliki</namePart>
            <namePart type="family">Lazaridou</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Omer</namePart>
            <namePart type="family">Levy</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Roi</namePart>
            <namePart type="family">Reichart</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Anders</namePart>
            <namePart type="family">Søgaard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Copenhagen, Denmark</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We introduce the cross-match test - an exact, distribution free, high-dimensional hypothesis test as an intrinsic evaluation metric for word embeddings. We show that cross-match is an effective means of measuring the distributional similarity between different vector representations and of evaluating the statistical significance of different vector embedding models. Additionally, we find that cross-match can be used to provide a quantitative measure of linguistic similarity for selecting bridge languages for machine translation. We demonstrate that the results of the hypothesis test align with our expectations and note that the framework of two sample hypothesis testing is not limited to word embeddings and can be extended to all vector representations.</abstract>
    <identifier type="citekey">gurnani-2017-hypothesis</identifier>
    <identifier type="doi">10.18653/v1/W17-5303</identifier>
    <location>
        <url>https://aclanthology.org/W17-5303</url>
    </location>
    <part>
        <date>2017-09</date>
        <extent unit="page">
            <start>16</start>
            <end>20</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Hypothesis Testing based Intrinsic Evaluation of Word Embeddings
%A Gurnani, Nishant
%Y Bowman, Samuel
%Y Goldberg, Yoav
%Y Hill, Felix
%Y Lazaridou, Angeliki
%Y Levy, Omer
%Y Reichart, Roi
%Y Søgaard, Anders
%S Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP
%D 2017
%8 September
%I Association for Computational Linguistics
%C Copenhagen, Denmark
%F gurnani-2017-hypothesis
%X We introduce the cross-match test - an exact, distribution free, high-dimensional hypothesis test as an intrinsic evaluation metric for word embeddings. We show that cross-match is an effective means of measuring the distributional similarity between different vector representations and of evaluating the statistical significance of different vector embedding models. Additionally, we find that cross-match can be used to provide a quantitative measure of linguistic similarity for selecting bridge languages for machine translation. We demonstrate that the results of the hypothesis test align with our expectations and note that the framework of two sample hypothesis testing is not limited to word embeddings and can be extended to all vector representations.
%R 10.18653/v1/W17-5303
%U https://aclanthology.org/W17-5303
%U https://doi.org/10.18653/v1/W17-5303
%P 16-20

Markdown (Informal)

[Hypothesis Testing based Intrinsic Evaluation of Word Embeddings](https://aclanthology.org/W17-5303) (Gurnani, RepEval 2017)

• Hypothesis Testing based Intrinsic Evaluation of Word Embeddings (Gurnani, RepEval 2017)

ACL

• Nishant Gurnani. 2017. Hypothesis Testing based Intrinsic Evaluation of Word Embeddings. In Proceedings of the 2nd Workshop on Evaluating Vector Space Representations for NLP, pages 16–20, Copenhagen, Denmark. Association for Computational Linguistics.