MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations

Ruggero Marino Lazzaroni; Alessandro Angioi; Michelangelo Puliga; Davide Sanna; Roberto Marras

MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations

Ruggero Marino Lazzaroni, Alessandro Angioi, Michelangelo Puliga, Davide Sanna, Roberto Marras

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Anthology ID:: 2025.clicit-1.55
Volume:: Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
Month:: September
Year:: 2025
Address:: Cagliari, Italy
Editors:: Cristina Bosco, Elisabetta Jezek, Marco Polignano, Manuela Sanguinetti
Venue:: CLiC-it
SIG:
Publisher:: CEUR Workshop Proceedings
Note:
Pages:: 570–581
Language:
URL:: https://aclanthology.org/2025.clicit-1.55/
DOI:
Bibkey:
Cite (ACL):: Ruggero Marino Lazzaroni, Alessandro Angioi, Michelangelo Puliga, Davide Sanna, and Roberto Marras. 2025. MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations. In Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), pages 570–581, Cagliari, Italy. CEUR Workshop Proceedings.
Cite (Informal):: MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations (Lazzaroni et al., CLiC-it 2025)
Copy Citation:
PDF:: https://aclanthology.org/2025.clicit-1.55.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{lazzaroni-etal-2025-medbench,
    title = "{M}ed{B}ench-{IT}: A Comprehensive Benchmark for Evaluating Large Language Models on {I}talian Medical Entrance Examinations",
    author = "Lazzaroni, Ruggero Marino  and
      Angioi, Alessandro  and
      Puliga, Michelangelo  and
      Sanna, Davide  and
      Marras, Roberto",
    editor = "Bosco, Cristina  and
      Jezek, Elisabetta  and
      Polignano, Marco  and
      Sanguinetti, Manuela",
    booktitle = "Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)",
    month = sep,
    year = "2025",
    address = "Cagliari, Italy",
    publisher = "CEUR Workshop Proceedings",
    url = "https://aclanthology.org/2025.clicit-1.55/",
    pages = "570--581",
    ISBN = "979-12-243-0587-3"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lazzaroni-etal-2025-medbench">
    <titleInfo>
        <title>MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Ruggero</namePart>
        <namePart type="given">Marino</namePart>
        <namePart type="family">Lazzaroni</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alessandro</namePart>
        <namePart type="family">Angioi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Michelangelo</namePart>
        <namePart type="family">Puliga</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Davide</namePart>
        <namePart type="family">Sanna</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Roberto</namePart>
        <namePart type="family">Marras</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Cristina</namePart>
            <namePart type="family">Bosco</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Elisabetta</namePart>
            <namePart type="family">Jezek</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Marco</namePart>
            <namePart type="family">Polignano</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Manuela</namePart>
            <namePart type="family">Sanguinetti</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>CEUR Workshop Proceedings</publisher>
            <place>
                <placeTerm type="text">Cagliari, Italy</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-12-243-0587-3</identifier>
    </relatedItem>
    <identifier type="citekey">lazzaroni-etal-2025-medbench</identifier>
    <location>
        <url>https://aclanthology.org/2025.clicit-1.55/</url>
    </location>
    <part>
        <date>2025-09</date>
        <extent unit="page">
            <start>570</start>
            <end>581</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations
%A Lazzaroni, Ruggero Marino
%A Angioi, Alessandro
%A Puliga, Michelangelo
%A Sanna, Davide
%A Marras, Roberto
%Y Bosco, Cristina
%Y Jezek, Elisabetta
%Y Polignano, Marco
%Y Sanguinetti, Manuela
%S Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
%D 2025
%8 September
%I CEUR Workshop Proceedings
%C Cagliari, Italy
%@ 979-12-243-0587-3
%F lazzaroni-etal-2025-medbench
%U https://aclanthology.org/2025.clicit-1.55/
%P 570-581

Download as File

Markdown (Informal)

[MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations](https://aclanthology.org/2025.clicit-1.55/) (Lazzaroni et al., CLiC-it 2025)

MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations (Lazzaroni et al., CLiC-it 2025)

ACL

Ruggero Marino Lazzaroni, Alessandro Angioi, Michelangelo Puliga, Davide Sanna, and Roberto Marras. 2025. MedBench-IT: A Comprehensive Benchmark for Evaluating Large Language Models on Italian Medical Entrance Examinations. In Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), pages 570–581, Cagliari, Italy. CEUR Workshop Proceedings.