The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence

Silvio Calderaro; Alessio Miaschi; Felice Dell’Orletta

The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence

Silvio Calderaro, Alessio Miaschi, Felice Dell’Orletta

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Anthology ID:: 2025.clicit-1.14
Volume:: Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
Month:: September
Year:: 2025
Address:: Cagliari, Italy
Editors:: Cristina Bosco, Elisabetta Jezek, Marco Polignano, Manuela Sanguinetti
Venue:: CLiC-it
SIG:
Publisher:: CEUR Workshop Proceedings
Note:
Pages:: 124–133
Language:
URL:: https://aclanthology.org/2025.clicit-1.14/
DOI:
Bibkey:
Cite (ACL):: Silvio Calderaro, Alessio Miaschi, and Felice Dell’Orletta. 2025. The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence. In Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), pages 124–133, Cagliari, Italy. CEUR Workshop Proceedings.
Cite (Informal):: The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence (Calderaro et al., CLiC-it 2025)
Copy Citation:
PDF:: https://aclanthology.org/2025.clicit-1.14.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{calderaro-etal-2025-oulibench,
    title = "The {O}u{L}i{B}ench Benchmark: Formal Constraints as a Lens into {LLM} Linguistic Competence",
    author = "Calderaro, Silvio  and
      Miaschi, Alessio  and
      Dell{'}Orletta, Felice",
    editor = "Bosco, Cristina  and
      Jezek, Elisabetta  and
      Polignano, Marco  and
      Sanguinetti, Manuela",
    booktitle = "Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)",
    month = sep,
    year = "2025",
    address = "Cagliari, Italy",
    publisher = "CEUR Workshop Proceedings",
    url = "https://aclanthology.org/2025.clicit-1.14/",
    pages = "124--133",
    ISBN = "979-12-243-0587-3"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="calderaro-etal-2025-oulibench">
    <titleInfo>
        <title>The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Silvio</namePart>
        <namePart type="family">Calderaro</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alessio</namePart>
        <namePart type="family">Miaschi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Felice</namePart>
        <namePart type="family">Dell’Orletta</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-09</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Cristina</namePart>
            <namePart type="family">Bosco</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Elisabetta</namePart>
            <namePart type="family">Jezek</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Marco</namePart>
            <namePart type="family">Polignano</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Manuela</namePart>
            <namePart type="family">Sanguinetti</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>CEUR Workshop Proceedings</publisher>
            <place>
                <placeTerm type="text">Cagliari, Italy</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-12-243-0587-3</identifier>
    </relatedItem>
    <identifier type="citekey">calderaro-etal-2025-oulibench</identifier>
    <location>
        <url>https://aclanthology.org/2025.clicit-1.14/</url>
    </location>
    <part>
        <date>2025-09</date>
        <extent unit="page">
            <start>124</start>
            <end>133</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence
%A Calderaro, Silvio
%A Miaschi, Alessio
%A Dell’Orletta, Felice
%Y Bosco, Cristina
%Y Jezek, Elisabetta
%Y Polignano, Marco
%Y Sanguinetti, Manuela
%S Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
%D 2025
%8 September
%I CEUR Workshop Proceedings
%C Cagliari, Italy
%@ 979-12-243-0587-3
%F calderaro-etal-2025-oulibench
%U https://aclanthology.org/2025.clicit-1.14/
%P 124-133

Download as File

Markdown (Informal)

[The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence](https://aclanthology.org/2025.clicit-1.14/) (Calderaro et al., CLiC-it 2025)

The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence (Calderaro et al., CLiC-it 2025)

ACL

Silvio Calderaro, Alessio Miaschi, and Felice Dell’Orletta. 2025. The OuLiBench Benchmark: Formal Constraints as a Lens into LLM Linguistic Competence. In Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), pages 124–133, Cagliari, Italy. CEUR Workshop Proceedings.