L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context

Pritika Rohera; Chaitrali Ginimav; Akanksha Salunke; Gayatri Sawant; Raviraj Joshi

L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context

Pritika Rohera, Chaitrali Ginimav, Akanksha Salunke, Gayatri Sawant, Raviraj Joshi

Correct Metadata for

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Anthology ID:: 2024.paclic-1.93
Volume:: Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Month:: December
Year:: 2024
Address:: Tokyo, Japan
Editors:: Nathaniel Oco, Shirley N. Dita, Ariane Macalinga Borlongan, Jong-Bok Kim
Venue:: PACLIC
SIG:
Publisher:: Tokyo University of Foreign Studies
Note:
Pages:: 982–988
Language:
URL:: https://aclanthology.org/2024.paclic-1.93/
DOI:
Bibkey:
Cite (ACL):: Pritika Rohera, Chaitrali Ginimav, Akanksha Salunke, Gayatri Sawant, and Raviraj Joshi. 2024. L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context. In Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation, pages 982–988, Tokyo, Japan. Tokyo University of Foreign Studies.
Cite (Informal):: L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context (Rohera et al., PACLIC 2024)
Copy Citation:
PDF:: https://aclanthology.org/2024.paclic-1.93.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{rohera-etal-2024-l3cube,
    title = "{L}3{C}ube-{I}ndic{Q}uest: A Benchmark Question Answering Dataset for Evaluating Knowledge of {LLM}s in {I}ndic Context",
    author = "Rohera, Pritika  and
      Ginimav, Chaitrali  and
      Salunke, Akanksha  and
      Sawant, Gayatri  and
      Joshi, Raviraj",
    editor = "Oco, Nathaniel  and
      Dita, Shirley N.  and
      Borlongan, Ariane Macalinga  and
      Kim, Jong-Bok",
    booktitle = "Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation",
    month = dec,
    year = "2024",
    address = "Tokyo, Japan",
    publisher = "Tokyo University of Foreign Studies",
    url = "https://aclanthology.org/2024.paclic-1.93/",
    pages = "982--988"
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="rohera-etal-2024-l3cube">
    <titleInfo>
        <title>L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Pritika</namePart>
        <namePart type="family">Rohera</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Chaitrali</namePart>
        <namePart type="family">Ginimav</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Akanksha</namePart>
        <namePart type="family">Salunke</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Gayatri</namePart>
        <namePart type="family">Sawant</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Raviraj</namePart>
        <namePart type="family">Joshi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Nathaniel</namePart>
            <namePart type="family">Oco</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Shirley</namePart>
            <namePart type="given">N</namePart>
            <namePart type="family">Dita</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ariane</namePart>
            <namePart type="given">Macalinga</namePart>
            <namePart type="family">Borlongan</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jong-Bok</namePart>
            <namePart type="family">Kim</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Tokyo University of Foreign Studies</publisher>
            <place>
                <placeTerm type="text">Tokyo, Japan</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <identifier type="citekey">rohera-etal-2024-l3cube</identifier>
    <location>
        <url>https://aclanthology.org/2024.paclic-1.93/</url>
    </location>
    <part>
        <date>2024-12</date>
        <extent unit="page">
            <start>982</start>
            <end>988</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context
%A Rohera, Pritika
%A Ginimav, Chaitrali
%A Salunke, Akanksha
%A Sawant, Gayatri
%A Joshi, Raviraj
%Y Oco, Nathaniel
%Y Dita, Shirley N.
%Y Borlongan, Ariane Macalinga
%Y Kim, Jong-Bok
%S Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
%D 2024
%8 December
%I Tokyo University of Foreign Studies
%C Tokyo, Japan
%F rohera-etal-2024-l3cube
%U https://aclanthology.org/2024.paclic-1.93/
%P 982-988

Download as File

Markdown (Informal)

[L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context](https://aclanthology.org/2024.paclic-1.93/) (Rohera et al., PACLIC 2024)

L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context (Rohera et al., PACLIC 2024)

ACL

Pritika Rohera, Chaitrali Ginimav, Akanksha Salunke, Gayatri Sawant, and Raviraj Joshi. 2024. L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context. In Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation, pages 982–988, Tokyo, Japan. Tokyo University of Foreign Studies.