AITutor-EvalKit: Exploring the Capabilities of AI Tutors

Numaan Naeem; Kaushal Kumar Maurya; Kseniia Petukhova; Ekaterina Kochmar

AITutor-EvalKit: Exploring the Capabilities of AI Tutors

Numaan Naeem, Kaushal Kumar Maurya, Kseniia Petukhova, Ekaterina Kochmar

Correct Metadata for

Use this form to create a GitHub issue with structured data describing the correction. You will need a GitHub account. Once you create that issue, the correction will be reviewed by a staff member.

⚠️ Mobile Users: Submitting this form to create a new issue will only work with github.com, not the GitHub Mobile app.

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>. You may use <b>...</b> for bold, <i>...</i> for italic, and <url>...</url> for URLs.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

We present AITutor-EvalKit, an application that uses language technology to evaluate the pedagogical quality of AI tutors, provides software for demonstration and evaluation, as well as model inspection and data visualization. This tool is aimed at education stakeholders as well as *ACL community at large, as it supports learning and can also be used to collect user feedback and annotation.

Anthology ID:: 2026.eacl-demo.32
Volume:: Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:: March
Year:: 2026
Address:: Rabat, Marocco
Editors:: Danilo Croce, Jochen Leidner, Nafise Sadat Moosavi
Venue:: EACL
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 457–479
Language:
URL:: https://aclanthology.org/2026.eacl-demo.32/
DOI:
Bibkey:
Cite (ACL):: Numaan Naeem, Kaushal Kumar Maurya, Kseniia Petukhova, and Ekaterina Kochmar. 2026. AITutor-EvalKit: Exploring the Capabilities of AI Tutors. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 457–479, Rabat, Marocco. Association for Computational Linguistics.
Cite (Informal):: AITutor-EvalKit: Exploring the Capabilities of AI Tutors (Naeem et al., EACL 2026)
Copy Citation:
PDF:: https://aclanthology.org/2026.eacl-demo.32.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{naeem-etal-2026-aitutor,
    title = "{AIT}utor-{E}val{K}it: Exploring the Capabilities of {AI} Tutors",
    author = "Naeem, Numaan  and
      Maurya, Kaushal Kumar  and
      Petukhova, Kseniia  and
      Kochmar, Ekaterina",
    editor = "Croce, Danilo  and
      Leidner, Jochen  and
      Moosavi, Nafise Sadat",
    booktitle = "Proceedings of the 19th Conference of the {E}uropean Chapter of the {A}ssociation for {C}omputational {L}inguistics (Volume 3: System Demonstrations)",
    month = mar,
    year = "2026",
    address = "Rabat, Marocco",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2026.eacl-demo.32/",
    pages = "457--479",
    ISBN = "979-8-89176-382-1",
    abstract = "We present AITutor-EvalKit, an application that uses language technology to evaluate the pedagogical quality of AI tutors, provides software for demonstration and evaluation, as well as model inspection and data visualization. This tool is aimed at education stakeholders as well as *ACL community at large, as it supports learning and can also be used to collect user feedback and annotation."
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="naeem-etal-2026-aitutor">
    <titleInfo>
        <title>AITutor-EvalKit: Exploring the Capabilities of AI Tutors</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Numaan</namePart>
        <namePart type="family">Naeem</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kaushal</namePart>
        <namePart type="given">Kumar</namePart>
        <namePart type="family">Maurya</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kseniia</namePart>
        <namePart type="family">Petukhova</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ekaterina</namePart>
        <namePart type="family">Kochmar</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-03</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Danilo</namePart>
            <namePart type="family">Croce</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jochen</namePart>
            <namePart type="family">Leidner</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Nafise</namePart>
            <namePart type="given">Sadat</namePart>
            <namePart type="family">Moosavi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Rabat, Marocco</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-382-1</identifier>
    </relatedItem>
    <abstract>We present AITutor-EvalKit, an application that uses language technology to evaluate the pedagogical quality of AI tutors, provides software for demonstration and evaluation, as well as model inspection and data visualization. This tool is aimed at education stakeholders as well as *ACL community at large, as it supports learning and can also be used to collect user feedback and annotation.</abstract>
    <identifier type="citekey">naeem-etal-2026-aitutor</identifier>
    <location>
        <url>https://aclanthology.org/2026.eacl-demo.32/</url>
    </location>
    <part>
        <date>2026-03</date>
        <extent unit="page">
            <start>457</start>
            <end>479</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T AITutor-EvalKit: Exploring the Capabilities of AI Tutors
%A Naeem, Numaan
%A Maurya, Kaushal Kumar
%A Petukhova, Kseniia
%A Kochmar, Ekaterina
%Y Croce, Danilo
%Y Leidner, Jochen
%Y Moosavi, Nafise Sadat
%S Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations)
%D 2026
%8 March
%I Association for Computational Linguistics
%C Rabat, Marocco
%@ 979-8-89176-382-1
%F naeem-etal-2026-aitutor
%X We present AITutor-EvalKit, an application that uses language technology to evaluate the pedagogical quality of AI tutors, provides software for demonstration and evaluation, as well as model inspection and data visualization. This tool is aimed at education stakeholders as well as *ACL community at large, as it supports learning and can also be used to collect user feedback and annotation.
%U https://aclanthology.org/2026.eacl-demo.32/
%P 457-479

Download as File

Markdown (Informal)

[AITutor-EvalKit: Exploring the Capabilities of AI Tutors](https://aclanthology.org/2026.eacl-demo.32/) (Naeem et al., EACL 2026)

AITutor-EvalKit: Exploring the Capabilities of AI Tutors (Naeem et al., EACL 2026)

ACL

Numaan Naeem, Kaushal Kumar Maurya, Kseniia Petukhova, and Ekaterina Kochmar. 2026. AITutor-EvalKit: Exploring the Capabilities of AI Tutors. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 457–479, Rabat, Marocco. Association for Computational Linguistics.