<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="imamovic-etal-2024-using">
    <titleInfo>
        <title>Using ChatGPT for Annotation of Attitude within the Appraisal Theory: Lessons Learned</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Mirela</namePart>
        <namePart type="family">Imamovic</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Silvana</namePart>
        <namePart type="family">Deilen</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Dylan</namePart>
        <namePart type="family">Glynn</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ekaterina</namePart>
        <namePart type="family">Lapshinova-Koltunski</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-03</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Sophie</namePart>
            <namePart type="family">Henning</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Manfred</namePart>
            <namePart type="family">Stede</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">St. Julians, Malta</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We investigate the potential of using ChatGPT to annotate complex linguistic phenomena, such as language of evaluation, attitude and emotion. For this, we automatically annotate 11 texts in English, which represent spoken popular science, and evaluate the annotations manually. Our results show that ChatGPT has good precision in itemisation, i.e. detecting linguistic items in the text that carry evaluative meaning. However, we also find that the recall is very low. Besides that, we state that the tool fails in labeling the detected items with the correct categories on a more fine-grained level of granularity. We analyse the errors to find systematic errors related to specific categories in the annotation scheme.</abstract>
    <identifier type="citekey">imamovic-etal-2024-using</identifier>
    <location>
        <url>https://aclanthology.org/2024.law-1.11</url>
    </location>
    <part>
        <date>2024-03</date>
        <extent unit="page">
            <start>112</start>
            <end>123</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Using ChatGPT for Annotation of Attitude within the Appraisal Theory: Lessons Learned
%A Imamovic, Mirela
%A Deilen, Silvana
%A Glynn, Dylan
%A Lapshinova-Koltunski, Ekaterina
%Y Henning, Sophie
%Y Stede, Manfred
%S Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII)
%D 2024
%8 March
%I Association for Computational Linguistics
%C St. Julians, Malta
%F imamovic-etal-2024-using
%X We investigate the potential of using ChatGPT to annotate complex linguistic phenomena, such as language of evaluation, attitude and emotion. For this, we automatically annotate 11 texts in English, which represent spoken popular science, and evaluate the annotations manually. Our results show that ChatGPT has good precision in itemisation, i.e. detecting linguistic items in the text that carry evaluative meaning. However, we also find that the recall is very low. Besides that, we state that the tool fails in labeling the detected items with the correct categories on a more fine-grained level of granularity. We analyse the errors to find systematic errors related to specific categories in the annotation scheme.
%U https://aclanthology.org/2024.law-1.11
%P 112-123

Markdown (Informal)

[Using ChatGPT for Annotation of Attitude within the Appraisal Theory: Lessons Learned](https://aclanthology.org/2024.law-1.11) (Imamovic et al., LAW-WS 2024)

• Using ChatGPT for Annotation of Attitude within the Appraisal Theory: Lessons Learned (Imamovic et al., LAW-WS 2024)

ACL

• Mirela Imamovic, Silvana Deilen, Dylan Glynn, and Ekaterina Lapshinova-Koltunski. 2024. Using ChatGPT for Annotation of Attitude within the Appraisal Theory: Lessons Learned. In Proceedings of The 18th Linguistic Annotation Workshop (LAW-XVIII), pages 112–123, St. Julians, Malta. Association for Computational Linguistics.