<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="basile-etal-2024-perseid">
    <titleInfo>
        <title>PERSEID - Perspectivist Irony Detection: A CALAMITA Challenge</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Valerio</namePart>
        <namePart type="family">Basile</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Silvia</namePart>
        <namePart type="family">Casola</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Simona</namePart>
        <namePart type="family">Frenda</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Soda</namePart>
        <namePart type="given">Marem</namePart>
        <namePart type="family">Lo</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Felice</namePart>
            <namePart type="family">Dell’Orletta</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Alessandro</namePart>
            <namePart type="family">Lenci</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Simonetta</namePart>
            <namePart type="family">Montemagni</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Rachele</namePart>
            <namePart type="family">Sprugnoli</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>CEUR Workshop Proceedings</publisher>
            <place>
                <placeTerm type="text">Pisa, Italy</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-12-210-7060-6</identifier>
    </relatedItem>
    <abstract>Works in perspectivism and human label variation have emphasized the need to collect and leverage various voices and points of view in the whole Natural Language Processing pipeline.PERSEID places itself in this line of work. We consider the task of irony detection from short social media conversations in Italian collected from Twitter (X) and Reddit. To do so, we leverage data from MultiPICO, a recent multilingual dataset with disaggregated annotations and annotators’ metadata, containing 1000 Post, Reply pairs with five annotations each on average.We aim to evaluate whether prompting LLMs with additional annotators’ demographic information (namely gender only, age only, and the combination of the two) results in improved performance compared to a baseline in which only the input text is provided.The evaluation is zero-shot; and we evaluate the results on the disaggregated annotations using f1.</abstract>
    <identifier type="citekey">basile-etal-2024-perseid</identifier>
    <location>
        <url>https://aclanthology.org/2024.clicit-1.118/</url>
    </location>
    <part>
        <date>2024-12</date>
        <extent unit="page">
            <start>1074</start>
            <end>1081</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T PERSEID - Perspectivist Irony Detection: A CALAMITA Challenge
%A Basile, Valerio
%A Casola, Silvia
%A Frenda, Simona
%A Lo, Soda Marem
%Y Dell’Orletta, Felice
%Y Lenci, Alessandro
%Y Montemagni, Simonetta
%Y Sprugnoli, Rachele
%S Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
%D 2024
%8 December
%I CEUR Workshop Proceedings
%C Pisa, Italy
%@ 979-12-210-7060-6
%F basile-etal-2024-perseid
%X Works in perspectivism and human label variation have emphasized the need to collect and leverage various voices and points of view in the whole Natural Language Processing pipeline.PERSEID places itself in this line of work. We consider the task of irony detection from short social media conversations in Italian collected from Twitter (X) and Reddit. To do so, we leverage data from MultiPICO, a recent multilingual dataset with disaggregated annotations and annotators’ metadata, containing 1000 Post, Reply pairs with five annotations each on average.We aim to evaluate whether prompting LLMs with additional annotators’ demographic information (namely gender only, age only, and the combination of the two) results in improved performance compared to a baseline in which only the input text is provided.The evaluation is zero-shot; and we evaluate the results on the disaggregated annotations using f1.
%U https://aclanthology.org/2024.clicit-1.118/
%P 1074-1081

Markdown (Informal)

[PERSEID - Perspectivist Irony Detection: A CALAMITA Challenge](https://aclanthology.org/2024.clicit-1.118/) (Basile et al., CLiC-it 2024)

• PERSEID - Perspectivist Irony Detection: A CALAMITA Challenge (Basile et al., CLiC-it 2024)

ACL

• Valerio Basile, Silvia Casola, Simona Frenda, and Soda Marem Lo. 2024. PERSEID - Perspectivist Irony Detection: A CALAMITA Challenge. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 1074–1081, Pisa, Italy. CEUR Workshop Proceedings.