<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lauretig-2019-identification">
    <titleInfo>
        <title>Identification, Interpretability, and Bayesian Word Embeddings</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Adam</namePart>
        <namePart type="family">Lauretig</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2019-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Third Workshop on Natural Language Processing and Computational Social Science</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Svitlana</namePart>
            <namePart type="family">Volkova</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">David</namePart>
            <namePart type="family">Jurgens</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Dirk</namePart>
            <namePart type="family">Hovy</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">David</namePart>
            <namePart type="family">Bamman</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Oren</namePart>
            <namePart type="family">Tsur</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Minneapolis, Minnesota</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Social scientists have recently turned to analyzing text using tools from natural language processing like word embeddings to measure concepts like ideology, bias, and affinity. However, word embeddings are difficult to use in the regression framework familiar to social scientists: embeddings are are neither identified, nor directly interpretable. I offer two advances on standard embedding models to remedy these problems. First, I develop Bayesian Word Embeddings with Automatic Relevance Determination priors, relaxing the assumption that all embedding dimensions have equal weight. Second, I apply work identifying latent variable models to anchor embeddings, identifying them, and making them interpretable and usable in a regression. I then apply this model and anchoring approach to two cases, the shift in internationalist rhetoric in the American presidents’ inaugural addresses, and the relationship between bellicosity in American foreign policy decision-makers’ deliberations. I find that inaugural addresses became less internationalist after 1945, which goes against the conventional wisdom, and that an increase in bellicosity is associated with an increase in hostile actions by the United States, showing that elite deliberations are not cheap talk, and helping confirm the validity of the model.</abstract>
    <identifier type="citekey">lauretig-2019-identification</identifier>
    <identifier type="doi">10.18653/v1/W19-2102</identifier>
    <location>
        <url>https://aclanthology.org/W19-2102</url>
    </location>
    <part>
        <date>2019-06</date>
        <extent unit="page">
            <start>7</start>
            <end>17</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Identification, Interpretability, and Bayesian Word Embeddings
%A Lauretig, Adam
%Y Volkova, Svitlana
%Y Jurgens, David
%Y Hovy, Dirk
%Y Bamman, David
%Y Tsur, Oren
%S Proceedings of the Third Workshop on Natural Language Processing and Computational Social Science
%D 2019
%8 June
%I Association for Computational Linguistics
%C Minneapolis, Minnesota
%F lauretig-2019-identification
%X Social scientists have recently turned to analyzing text using tools from natural language processing like word embeddings to measure concepts like ideology, bias, and affinity. However, word embeddings are difficult to use in the regression framework familiar to social scientists: embeddings are are neither identified, nor directly interpretable. I offer two advances on standard embedding models to remedy these problems. First, I develop Bayesian Word Embeddings with Automatic Relevance Determination priors, relaxing the assumption that all embedding dimensions have equal weight. Second, I apply work identifying latent variable models to anchor embeddings, identifying them, and making them interpretable and usable in a regression. I then apply this model and anchoring approach to two cases, the shift in internationalist rhetoric in the American presidents’ inaugural addresses, and the relationship between bellicosity in American foreign policy decision-makers’ deliberations. I find that inaugural addresses became less internationalist after 1945, which goes against the conventional wisdom, and that an increase in bellicosity is associated with an increase in hostile actions by the United States, showing that elite deliberations are not cheap talk, and helping confirm the validity of the model.
%R 10.18653/v1/W19-2102
%U https://aclanthology.org/W19-2102
%U https://doi.org/10.18653/v1/W19-2102
%P 7-17

Markdown (Informal)

[Identification, Interpretability, and Bayesian Word Embeddings](https://aclanthology.org/W19-2102) (Lauretig, NLP+CSS 2019)

• Identification, Interpretability, and Bayesian Word Embeddings (Lauretig, NLP+CSS 2019)

ACL

• Adam Lauretig. 2019. Identification, Interpretability, and Bayesian Word Embeddings. In Proceedings of the Third Workshop on Natural Language Processing and Computational Social Science, pages 7–17, Minneapolis, Minnesota. Association for Computational Linguistics.