<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="kalpakchi-boye-2023-quasi">
    <titleInfo>
        <title>Quasi: a synthetic Question-Answering dataset in Swedish using GPT-3 and zero-shot learning</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Dmytro</namePart>
        <namePart type="family">Kalpakchi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Johan</namePart>
        <namePart type="family">Boye</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Tanel</namePart>
            <namePart type="family">Alumäe</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Mark</namePart>
            <namePart type="family">Fishel</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>University of Tartu Library</publisher>
            <place>
                <placeTerm type="text">Tórshavn, Faroe Islands</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper describes the creation and evaluation of a synthetic dataset of Swedish multiple-choice questions (MCQs) for reading comprehension using GPT-3. Although GPT-3 is trained mostly on English data, with only 0.11% of Swedish texts in its training material, the model still managed to generate MCQs in Swedish. About 44% of the generated MCQs turned out to be of sufficient quality, i.e. they were grammatically correct and relevant, with exactly one answer alternative being correct and the others being plausible but wrong. We provide a detailed analysis of the errors and shortcomings of the rejected MCQs, as well an analysis of the level of difficulty of the accepted MCQs. In addition to giving insights into GPT-3, the synthetic dataset could be used for training and evaluation of special-purpose MCQ-generating models.</abstract>
    <identifier type="citekey">kalpakchi-boye-2023-quasi</identifier>
    <location>
        <url>https://aclanthology.org/2023.nodalida-1.48</url>
    </location>
    <part>
        <date>2023-05</date>
        <extent unit="page">
            <start>477</start>
            <end>491</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Quasi: a synthetic Question-Answering dataset in Swedish using GPT-3 and zero-shot learning
%A Kalpakchi, Dmytro
%A Boye, Johan
%Y Alumäe, Tanel
%Y Fishel, Mark
%S Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa)
%D 2023
%8 May
%I University of Tartu Library
%C Tórshavn, Faroe Islands
%F kalpakchi-boye-2023-quasi
%X This paper describes the creation and evaluation of a synthetic dataset of Swedish multiple-choice questions (MCQs) for reading comprehension using GPT-3. Although GPT-3 is trained mostly on English data, with only 0.11% of Swedish texts in its training material, the model still managed to generate MCQs in Swedish. About 44% of the generated MCQs turned out to be of sufficient quality, i.e. they were grammatically correct and relevant, with exactly one answer alternative being correct and the others being plausible but wrong. We provide a detailed analysis of the errors and shortcomings of the rejected MCQs, as well an analysis of the level of difficulty of the accepted MCQs. In addition to giving insights into GPT-3, the synthetic dataset could be used for training and evaluation of special-purpose MCQ-generating models.
%U https://aclanthology.org/2023.nodalida-1.48
%P 477-491

Markdown (Informal)

[Quasi: a synthetic Question-Answering dataset in Swedish using GPT-3 and zero-shot learning](https://aclanthology.org/2023.nodalida-1.48) (Kalpakchi & Boye, NoDaLiDa 2023)

• Quasi: a synthetic Question-Answering dataset in Swedish using GPT-3 and zero-shot learning (Kalpakchi & Boye, NoDaLiDa 2023)

ACL

• Dmytro Kalpakchi and Johan Boye. 2023. Quasi: a synthetic Question-Answering dataset in Swedish using GPT-3 and zero-shot learning. In Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa), pages 477–491, Tórshavn, Faroe Islands. University of Tartu Library.