<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="weinzierl-harabagiu-2023-identification">
    <titleInfo>
        <title>Identification of Multimodal Stance Towards Frames of Communication</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Maxwell</namePart>
        <namePart type="family">Weinzierl</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sanda</namePart>
        <namePart type="family">Harabagiu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Houda</namePart>
            <namePart type="family">Bouamor</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Juan</namePart>
            <namePart type="family">Pino</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Kalika</namePart>
            <namePart type="family">Bali</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Singapore</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Frames of communication are often evoked in multimedia documents. When an author decides to add an image to a text, one or both of the modalities may evoke a communication frame. Moreover, when evoking the frame, the author also conveys her/his stance towards the frame. Until now, determining if the author is in favor of, against or has no stance towards the frame was performed automatically only when processing texts. This is due to the absence of stance annotations on multimedia documents. In this paper we introduce MMVax-Stance, a dataset of 11,300 multimedia documents retrieved from social media, which have stance annotations towards 113 different frames of communication. This dataset allowed us to experiment with several models of multimedia stance detection, which revealed important interactions between texts and images in the inference of stance towards communication frames. When inferring the text/image relations, a set of 46,606 synthetic examples of multimodal documents with known stance was generated. This greatly impacted the quality of identifying multimedia stance, yielding an improvement of 20% in F1-score.</abstract>
    <identifier type="citekey">weinzierl-harabagiu-2023-identification</identifier>
    <identifier type="doi">10.18653/v1/2023.emnlp-main.776</identifier>
    <location>
        <url>https://aclanthology.org/2023.emnlp-main.776</url>
    </location>
    <part>
        <date>2023-12</date>
        <extent unit="page">
            <start>12597</start>
            <end>12609</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Identification of Multimodal Stance Towards Frames of Communication
%A Weinzierl, Maxwell
%A Harabagiu, Sanda
%Y Bouamor, Houda
%Y Pino, Juan
%Y Bali, Kalika
%S Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
%D 2023
%8 December
%I Association for Computational Linguistics
%C Singapore
%F weinzierl-harabagiu-2023-identification
%X Frames of communication are often evoked in multimedia documents. When an author decides to add an image to a text, one or both of the modalities may evoke a communication frame. Moreover, when evoking the frame, the author also conveys her/his stance towards the frame. Until now, determining if the author is in favor of, against or has no stance towards the frame was performed automatically only when processing texts. This is due to the absence of stance annotations on multimedia documents. In this paper we introduce MMVax-Stance, a dataset of 11,300 multimedia documents retrieved from social media, which have stance annotations towards 113 different frames of communication. This dataset allowed us to experiment with several models of multimedia stance detection, which revealed important interactions between texts and images in the inference of stance towards communication frames. When inferring the text/image relations, a set of 46,606 synthetic examples of multimodal documents with known stance was generated. This greatly impacted the quality of identifying multimedia stance, yielding an improvement of 20% in F1-score.
%R 10.18653/v1/2023.emnlp-main.776
%U https://aclanthology.org/2023.emnlp-main.776
%U https://doi.org/10.18653/v1/2023.emnlp-main.776
%P 12597-12609

Markdown (Informal)

[Identification of Multimodal Stance Towards Frames of Communication](https://aclanthology.org/2023.emnlp-main.776) (Weinzierl & Harabagiu, EMNLP 2023)

• Identification of Multimodal Stance Towards Frames of Communication (Weinzierl & Harabagiu, EMNLP 2023)

ACL

• Maxwell Weinzierl and Sanda Harabagiu. 2023. Identification of Multimodal Stance Towards Frames of Communication. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 12597–12609, Singapore. Association for Computational Linguistics.