Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams

Ruben Piperno; Agnese Bonfigli; Felice Dell’Orletta; Leandro Pecchia; Mario Merone; Luca Bacco

Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams

Ruben Piperno, Agnese Bonfigli, Felice Dell’Orletta, Leandro Pecchia, Mario Merone, Luca Bacco

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Anthology ID:: 2025.clicit-1.85
Volume:: Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
Month:: September
Year:: 2025
Address:: Cagliari, Italy
Editors:: Cristina Bosco, Elisabetta Jezek, Marco Polignano, Manuela Sanguinetti
Venue:: CLiC-it
SIG:
Publisher:: CEUR Workshop Proceedings
Note:
Pages:: 911–923
Language:
URL:: https://aclanthology.org/2025.clicit-1.85/
DOI:
Bibkey:
Cite (ACL):: Ruben Piperno, Agnese Bonfigli, Felice Dell’Orletta, Leandro Pecchia, Mario Merone, and Luca Bacco. 2025. Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams. In Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), pages 911–923, Cagliari, Italy. CEUR Workshop Proceedings.
Cite (Informal):: Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams (Piperno et al., CLiC-it 2025)
Copy Citation:
PDF:: https://aclanthology.org/2025.clicit-1.85.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{piperno-etal-2025-doctor,
    title = "Doctor, Is That You? Evaluating Large Language Models on {I}taly{'}s Medical School Entrance Exams",
    author = "Piperno, Ruben  and
      Bonfigli, Agnese  and
      Dell{'}Orletta, Felice  and
      Pecchia, Leandro  and
      Merone, Mario  and
      Bacco, Luca",
    editor = "Bosco, Cristina  and
      Jezek, Elisabetta  and
      Polignano, Marco  and
      Sanguinetti, Manuela",
    booktitle = "Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)",
    month = sep,
    year = "2025",
    address = "Cagliari, Italy",
    publisher = "CEUR Workshop Proceedings",
    url = "https://aclanthology.org/2025.clicit-1.85/",
    pages = "911--923",
    ISBN = "979-12-243-0587-3"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="piperno-etal-2025-doctor">
    <titleInfo>
        <title>Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ruben</namePart>
        <namePart type="family">Piperno</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Agnese</namePart>
        <namePart type="family">Bonfigli</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Felice</namePart>
        <namePart type="family">Dell’Orletta</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Leandro</namePart>
        <namePart type="family">Pecchia</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mario</namePart>
        <namePart type="family">Merone</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Luca</namePart>
        <namePart type="family">Bacco</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Cristina</namePart>
            <namePart type="family">Bosco</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Elisabetta</namePart>
            <namePart type="family">Jezek</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Marco</namePart>
            <namePart type="family">Polignano</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Manuela</namePart>
            <namePart type="family">Sanguinetti</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>CEUR Workshop Proceedings</publisher>
            <place>
                <placeTerm type="text">Cagliari, Italy</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-12-243-0587-3</identifier>
    </relatedItem>
    <identifier type="citekey">piperno-etal-2025-doctor</identifier>
    <location>
        <url>https://aclanthology.org/2025.clicit-1.85/</url>
    </location>
    <part>
        <date>2025-09</date>
        <extent unit="page">
            <start>911</start>
            <end>923</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams
%A Piperno, Ruben
%A Bonfigli, Agnese
%A Dell’Orletta, Felice
%A Pecchia, Leandro
%A Merone, Mario
%A Bacco, Luca
%Y Bosco, Cristina
%Y Jezek, Elisabetta
%Y Polignano, Marco
%Y Sanguinetti, Manuela
%S Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
%D 2025
%8 September
%I CEUR Workshop Proceedings
%C Cagliari, Italy
%@ 979-12-243-0587-3
%F piperno-etal-2025-doctor
%U https://aclanthology.org/2025.clicit-1.85/
%P 911-923

Download as File

Markdown (Informal)

[Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams](https://aclanthology.org/2025.clicit-1.85/) (Piperno et al., CLiC-it 2025)

Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams (Piperno et al., CLiC-it 2025)

ACL

Ruben Piperno, Agnese Bonfigli, Felice Dell’Orletta, Leandro Pecchia, Mario Merone, and Luca Bacco. 2025. Doctor, Is That You? Evaluating Large Language Models on Italy’s Medical School Entrance Exams. In Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), pages 911–923, Cagliari, Italy. CEUR Workshop Proceedings.