Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers

Nikita Andreev; Alexander Shirnin; Vladislav Mikhailov; Ekaterina Artemova

Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers

Nikita Andreev, Alexander Shirnin, Vladislav Mikhailov, Ekaterina Artemova

Correct Metadata for

Use this form to create a GitHub issue with structured data describing the correction. You will need a GitHub account. Once you create that issue, the correction will be reviewed by a staff member.

⚠️ Mobile Users: Submitting this form to create a new issue will only work with github.com, not the GitHub Mobile app.

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>. You may use <b>...</b> for bold, <i>...</i> for italic, and <url>...</url> for URLs.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

This paper presents Papilusion, an AI-generated scientific text detector developed within the DAGPap24 shared task on detecting automatically generated scientific papers. We propose an ensemble-based approach and conduct ablation studies to analyze the effect of the detector configurations on the performance. Papilusion is ranked 6th on the leaderboard, and we improve our performance after the competition ended, achieving 99.46 (+9.63) of the F1-score on the official test set.

Anthology ID:: 2024.sdp-1.20
Volume:: Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)
Month:: August
Year:: 2024
Address:: Bangkok, Thailand
Editors:: Tirthankar Ghosal, Amanpreet Singh, Anita Waard, Philipp Mayr, Aakanksha Naik, Orion Weller, Yoonjoo Lee, Shannon Shen, Yanxia Qin
Venues:: sdp | WS
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 215–219
Language:
URL:: https://aclanthology.org/2024.sdp-1.20/
DOI:
Bibkey:
Cite (ACL):: Nikita Andreev, Alexander Shirnin, Vladislav Mikhailov, and Ekaterina Artemova. 2024. Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers. In Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), pages 215–219, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):: Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers (Andreev et al., sdp 2024)
Copy Citation:
PDF:: https://aclanthology.org/2024.sdp-1.20.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{andreev-etal-2024-papilusion,
    title = "Papilusion at {DAGP}ap24: Paper or Illusion? Detecting {AI}-generated Scientific Papers",
    author = "Andreev, Nikita  and
      Shirnin, Alexander  and
      Mikhailov, Vladislav  and
      Artemova, Ekaterina",
    editor = "Ghosal, Tirthankar  and
      Singh, Amanpreet  and
      Waard, Anita  and
      Mayr, Philipp  and
      Naik, Aakanksha  and
      Weller, Orion  and
      Lee, Yoonjoo  and
      Shen, Shannon  and
      Qin, Yanxia",
    booktitle = "Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)",
    month = aug,
    year = "2024",
    address = "Bangkok, Thailand",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.sdp-1.20/",
    pages = "215--219",
    abstract = "This paper presents Papilusion, an AI-generated scientific text detector developed within the DAGPap24 shared task on detecting automatically generated scientific papers. We propose an ensemble-based approach and conduct ablation studies to analyze the effect of the detector configurations on the performance. Papilusion is ranked 6th on the leaderboard, and we improve our performance after the competition ended, achieving 99.46 (+9.63) of the F1-score on the official test set."
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="andreev-etal-2024-papilusion">
    <titleInfo>
        <title>Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Nikita</namePart>
        <namePart type="family">Andreev</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alexander</namePart>
        <namePart type="family">Shirnin</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Vladislav</namePart>
        <namePart type="family">Mikhailov</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ekaterina</namePart>
        <namePart type="family">Artemova</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-08</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Tirthankar</namePart>
            <namePart type="family">Ghosal</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Amanpreet</namePart>
            <namePart type="family">Singh</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Anita</namePart>
            <namePart type="family">Waard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Philipp</namePart>
            <namePart type="family">Mayr</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Aakanksha</namePart>
            <namePart type="family">Naik</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Orion</namePart>
            <namePart type="family">Weller</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yoonjoo</namePart>
            <namePart type="family">Lee</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Shannon</namePart>
            <namePart type="family">Shen</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yanxia</namePart>
            <namePart type="family">Qin</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Bangkok, Thailand</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper presents Papilusion, an AI-generated scientific text detector developed within the DAGPap24 shared task on detecting automatically generated scientific papers. We propose an ensemble-based approach and conduct ablation studies to analyze the effect of the detector configurations on the performance. Papilusion is ranked 6th on the leaderboard, and we improve our performance after the competition ended, achieving 99.46 (+9.63) of the F1-score on the official test set.</abstract>
    <identifier type="citekey">andreev-etal-2024-papilusion</identifier>
    <location>
        <url>https://aclanthology.org/2024.sdp-1.20/</url>
    </location>
    <part>
        <date>2024-08</date>
        <extent unit="page">
            <start>215</start>
            <end>219</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers
%A Andreev, Nikita
%A Shirnin, Alexander
%A Mikhailov, Vladislav
%A Artemova, Ekaterina
%Y Ghosal, Tirthankar
%Y Singh, Amanpreet
%Y Waard, Anita
%Y Mayr, Philipp
%Y Naik, Aakanksha
%Y Weller, Orion
%Y Lee, Yoonjoo
%Y Shen, Shannon
%Y Qin, Yanxia
%S Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024)
%D 2024
%8 August
%I Association for Computational Linguistics
%C Bangkok, Thailand
%F andreev-etal-2024-papilusion
%X This paper presents Papilusion, an AI-generated scientific text detector developed within the DAGPap24 shared task on detecting automatically generated scientific papers. We propose an ensemble-based approach and conduct ablation studies to analyze the effect of the detector configurations on the performance. Papilusion is ranked 6th on the leaderboard, and we improve our performance after the competition ended, achieving 99.46 (+9.63) of the F1-score on the official test set.
%U https://aclanthology.org/2024.sdp-1.20/
%P 215-219

Download as File

Markdown (Informal)

[Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers](https://aclanthology.org/2024.sdp-1.20/) (Andreev et al., sdp 2024)

Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers (Andreev et al., sdp 2024)

ACL

Nikita Andreev, Alexander Shirnin, Vladislav Mikhailov, and Ekaterina Artemova. 2024. Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers. In Proceedings of the Fourth Workshop on Scholarly Document Processing (SDP 2024), pages 215–219, Bangkok, Thailand. Association for Computational Linguistics.