ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding

Israel Abebe Azime; Atnafu Lambebo Tonja; Tadesse Destaw Belay; Yonas Chanie; Bontu Fufa Balcha; Negasi Haile Abadi; Henok Biadglign Ademtew; Mulubrhan Abebe Nerea; Debela Desalegn Yadeta; Derartu Dagne Geremew; Assefa Atsbiha Tesfu; Philipp Slusallek; Thamar Solorio; Dietrich Klakow

doi:10.18653/v1/2025.findings-naacl.350

ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding

Israel Abebe Azime, Atnafu Lambebo Tonja, Tadesse Destaw Belay, Yonas Chanie, Bontu Fufa Balcha, Negasi Haile Abadi, Henok Biadglign Ademtew, Mulubrhan Abebe Nerea, Debela Desalegn Yadeta, Derartu Dagne Geremew, Assefa Atsbiha Tesfu, Philipp Slusallek, Thamar Solorio, Dietrich Klakow

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Anthology ID:: 2025.findings-naacl.350
Original:: 2025.findings-naacl.350v1
Version 2:: 2025.findings-naacl.350v2
Volume:: Findings of the Association for Computational Linguistics: NAACL 2025
Month:: April
Year:: 2025
Address:: Albuquerque, New Mexico
Editors:: Luis Chiruzzo, Alan Ritter, Lu Wang
Venue:: Findings
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 6250–6266
Language:
URL:: https://aclanthology.org/2025.findings-naacl.350/
DOI:: 10.18653/v1/2025.findings-naacl.350
Bibkey:
Cite (ACL):: Israel Abebe Azime, Atnafu Lambebo Tonja, Tadesse Destaw Belay, Yonas Chanie, Bontu Fufa Balcha, Negasi Haile Abadi, Henok Biadglign Ademtew, Mulubrhan Abebe Nerea, Debela Desalegn Yadeta, Derartu Dagne Geremew, Assefa Atsbiha Tesfu, Philipp Slusallek, Thamar Solorio, and Dietrich Klakow. 2025. ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 6250–6266, Albuquerque, New Mexico. Association for Computational Linguistics.
Cite (Informal):: ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding (Azime et al., Findings 2025)
Copy Citation:
PDF:: https://aclanthology.org/2025.findings-naacl.350.pdf

PDF (v2) PDF (v1) Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{azime-etal-2025-proverbeval,
    title = "{P}roverb{E}val: Exploring {LLM} Evaluation Challenges for Low-resource Language Understanding",
    author = "Azime, Israel Abebe  and
      Tonja, Atnafu Lambebo  and
      Belay, Tadesse Destaw  and
      Chanie, Yonas  and
      Balcha, Bontu Fufa  and
      Abadi, Negasi Haile  and
      Ademtew, Henok Biadglign  and
      Nerea, Mulubrhan Abebe  and
      Yadeta, Debela Desalegn  and
      Geremew, Derartu Dagne  and
      Tesfu, Assefa Atsbiha  and
      Slusallek, Philipp  and
      Solorio, Thamar  and
      Klakow, Dietrich",
    editor = "Chiruzzo, Luis  and
      Ritter, Alan  and
      Wang, Lu",
    booktitle = "Findings of the Association for Computational Linguistics: NAACL 2025",
    month = apr,
    year = "2025",
    address = "Albuquerque, New Mexico",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2025.findings-naacl.350/",
    doi = "10.18653/v1/2025.findings-naacl.350",
    pages = "6250--6266",
    ISBN = "979-8-89176-195-7"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="azime-etal-2025-proverbeval">
    <titleInfo>
        <title>ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Israel</namePart>
        <namePart type="given">Abebe</namePart>
        <namePart type="family">Azime</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Atnafu</namePart>
        <namePart type="given">Lambebo</namePart>
        <namePart type="family">Tonja</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Tadesse</namePart>
        <namePart type="given">Destaw</namePart>
        <namePart type="family">Belay</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Yonas</namePart>
        <namePart type="family">Chanie</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Bontu</namePart>
        <namePart type="given">Fufa</namePart>
        <namePart type="family">Balcha</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Negasi</namePart>
        <namePart type="given">Haile</namePart>
        <namePart type="family">Abadi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Henok</namePart>
        <namePart type="given">Biadglign</namePart>
        <namePart type="family">Ademtew</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mulubrhan</namePart>
        <namePart type="given">Abebe</namePart>
        <namePart type="family">Nerea</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Debela</namePart>
        <namePart type="given">Desalegn</namePart>
        <namePart type="family">Yadeta</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Derartu</namePart>
        <namePart type="given">Dagne</namePart>
        <namePart type="family">Geremew</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Assefa</namePart>
        <namePart type="given">Atsbiha</namePart>
        <namePart type="family">Tesfu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Philipp</namePart>
        <namePart type="family">Slusallek</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Thamar</namePart>
        <namePart type="family">Solorio</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Dietrich</namePart>
        <namePart type="family">Klakow</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-04</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: NAACL 2025</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Luis</namePart>
            <namePart type="family">Chiruzzo</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Alan</namePart>
            <namePart type="family">Ritter</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Lu</namePart>
            <namePart type="family">Wang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Albuquerque, New Mexico</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-195-7</identifier>
    </relatedItem>
    <identifier type="citekey">azime-etal-2025-proverbeval</identifier>
    <identifier type="doi">10.18653/v1/2025.findings-naacl.350</identifier>
    <location>
        <url>https://aclanthology.org/2025.findings-naacl.350/</url>
    </location>
    <part>
        <date>2025-04</date>
        <extent unit="page">
            <start>6250</start>
            <end>6266</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding
%A Azime, Israel Abebe
%A Tonja, Atnafu Lambebo
%A Belay, Tadesse Destaw
%A Chanie, Yonas
%A Balcha, Bontu Fufa
%A Abadi, Negasi Haile
%A Ademtew, Henok Biadglign
%A Nerea, Mulubrhan Abebe
%A Yadeta, Debela Desalegn
%A Geremew, Derartu Dagne
%A Tesfu, Assefa Atsbiha
%A Slusallek, Philipp
%A Solorio, Thamar
%A Klakow, Dietrich
%Y Chiruzzo, Luis
%Y Ritter, Alan
%Y Wang, Lu
%S Findings of the Association for Computational Linguistics: NAACL 2025
%D 2025
%8 April
%I Association for Computational Linguistics
%C Albuquerque, New Mexico
%@ 979-8-89176-195-7
%F azime-etal-2025-proverbeval
%R 10.18653/v1/2025.findings-naacl.350
%U https://aclanthology.org/2025.findings-naacl.350/
%U https://doi.org/10.18653/v1/2025.findings-naacl.350
%P 6250-6266

Download as File

Markdown (Informal)

[ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding](https://aclanthology.org/2025.findings-naacl.350/) (Azime et al., Findings 2025)

ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding (Azime et al., Findings 2025)

ACL

Israel Abebe Azime, Atnafu Lambebo Tonja, Tadesse Destaw Belay, Yonas Chanie, Bontu Fufa Balcha, Negasi Haile Abadi, Henok Biadglign Ademtew, Mulubrhan Abebe Nerea, Debela Desalegn Yadeta, Derartu Dagne Geremew, Assefa Atsbiha Tesfu, Philipp Slusallek, Thamar Solorio, and Dietrich Klakow. 2025. ProverbEval: Exploring LLM Evaluation Challenges for Low-resource Language Understanding. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 6250–6266, Albuquerque, New Mexico. Association for Computational Linguistics.