UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG

Minna Tran; Ryan McCarthy; Aiden Parsons; Jaren Unzen; Laura Dietz

UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG

Minna Tran, Ryan McCarthy, Aiden Parsons, Jaren Unzen, Laura Dietz

Correct Metadata for

Use this form to create a GitHub issue with structured data describing the correction. You will need a GitHub account. Once you create that issue, the correction will be reviewed by a staff member.

⚠️ Mobile Users: Submitting this form to create a new issue will only work with github.com, not the GitHub Mobile app.

Important: The Anthology treat PDFs as authoritative. Please use this form only to correct data that is out of line with the PDF. See our corrections guidelines if you need to change the PDF.

Title Adjust the title. Retain tags such as <fixed-case>.

Authors Adjust author names and order to match the PDF.

Abstract Correct abstract if needed. Retain XML formatting tags such as <tex-math>. You may use <b>...</b> for bold, <i>...</i> for italic, and <url>...</url> for URLs.

Verification against PDF Ensure that the new title/authors match the snapshot below. (If there is no snapshot or it is too small, consult the PDF.)

Authors concatenated from the text boxes above:

ALL author names match the snapshot above—including middle initials, hyphens, and accents.

Abstract

We submitted a breadth of LLM-as-a-Judge approaches to Rag4Reports Task A; our top method ranked first among all submitted systems. We find that citation faithfulness is the most essential signal, and that content is best verified by checking whether cited documents cover nuggets generated from the LLM’s internal knowledge.

Anthology ID:: 2026.rag4reports-1.9
Volume:: Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026)
Month:: July
Year:: 2026
Address:: San Diego, CA, USA
Editors:: Eugene Yang, Dawn Lawrie, Sean MacAvaney, James Mayfield, Luca Soldaini, Andrew Yates
Venues:: RAG4Reports | WS
SIG:
Publisher:: Association for Computational Linguistics
Note:
Pages:: 71–76
Language:
URL:: https://aclanthology.org/2026.rag4reports-1.9/
DOI:
Bibkey:
Cite (ACL):: Minna Tran, Ryan McCarthy, Aiden Parsons, Jaren Unzen, and Laura Dietz. 2026. UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG. In Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026), pages 71–76, San Diego, CA, USA. Association for Computational Linguistics.
Cite (Informal):: UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG (Tran et al., RAG4Reports 2026)
Copy Citation:
PDF:: https://aclanthology.org/2026.rag4reports-1.9.pdf

PDF Cite Search Fix data

Export citation

BibTeX
MODS XML
Endnote
Preformatted

@inproceedings{tran-etal-2026-unh,
    title = "{UNH} @ {R}ag4{R}eports: A Broad Exploration of {LLM}-Judges for {RAG}",
    author = "Tran, Minna  and
      McCarthy, Ryan  and
      Parsons, Aiden  and
      Unzen, Jaren  and
      Dietz, Laura",
    editor = "Yang, Eugene  and
      Lawrie, Dawn  and
      MacAvaney, Sean  and
      Mayfield, James  and
      Soldaini, Luca  and
      Yates, Andrew",
    booktitle = "Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation ({RAG}4{R}eports 2026)",
    month = jul,
    year = "2026",
    address = "San Diego, CA, USA",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2026.rag4reports-1.9/",
    pages = "71--76",
    ISBN = "979-8-89176-417-0",
    abstract = "We submitted a breadth of LLM-as-a-Judge approaches to Rag4Reports Task A; our top method ranked first among all submitted systems. We find that citation faithfulness is the most essential signal, and that content is best verified by checking whether cited documents cover nuggets generated from the LLM{'}s internal knowledge."
}

Download as File

<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="tran-etal-2026-unh">
    <titleInfo>
        <title>UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Minna</namePart>
        <namePart type="family">Tran</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ryan</namePart>
        <namePart type="family">McCarthy</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Aiden</namePart>
        <namePart type="family">Parsons</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Jaren</namePart>
        <namePart type="family">Unzen</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Laura</namePart>
        <namePart type="family">Dietz</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Eugene</namePart>
            <namePart type="family">Yang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Dawn</namePart>
            <namePart type="family">Lawrie</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sean</namePart>
            <namePart type="family">MacAvaney</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">James</namePart>
            <namePart type="family">Mayfield</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Luca</namePart>
            <namePart type="family">Soldaini</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Andrew</namePart>
            <namePart type="family">Yates</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">San Diego, CA, USA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-417-0</identifier>
    </relatedItem>
    <abstract>We submitted a breadth of LLM-as-a-Judge approaches to Rag4Reports Task A; our top method ranked first among all submitted systems. We find that citation faithfulness is the most essential signal, and that content is best verified by checking whether cited documents cover nuggets generated from the LLM’s internal knowledge.</abstract>
    <identifier type="citekey">tran-etal-2026-unh</identifier>
    <location>
        <url>https://aclanthology.org/2026.rag4reports-1.9/</url>
    </location>
    <part>
        <date>2026-07</date>
        <extent unit="page">
            <start>71</start>
            <end>76</end>
        </extent>
    </part>
</mods>
</modsCollection>

Download as File

%0 Conference Proceedings
%T UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG
%A Tran, Minna
%A McCarthy, Ryan
%A Parsons, Aiden
%A Unzen, Jaren
%A Dietz, Laura
%Y Yang, Eugene
%Y Lawrie, Dawn
%Y MacAvaney, Sean
%Y Mayfield, James
%Y Soldaini, Luca
%Y Yates, Andrew
%S Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026)
%D 2026
%8 July
%I Association for Computational Linguistics
%C San Diego, CA, USA
%@ 979-8-89176-417-0
%F tran-etal-2026-unh
%X We submitted a breadth of LLM-as-a-Judge approaches to Rag4Reports Task A; our top method ranked first among all submitted systems. We find that citation faithfulness is the most essential signal, and that content is best verified by checking whether cited documents cover nuggets generated from the LLM’s internal knowledge.
%U https://aclanthology.org/2026.rag4reports-1.9/
%P 71-76

Download as File

Markdown (Informal)

[UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG](https://aclanthology.org/2026.rag4reports-1.9/) (Tran et al., RAG4Reports 2026)

UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG (Tran et al., RAG4Reports 2026)

ACL

Minna Tran, Ryan McCarthy, Aiden Parsons, Jaren Unzen, and Laura Dietz. 2026. UNH @ Rag4Reports: A Broad Exploration of LLM-Judges for RAG. In Proceedings of the 1st Workshop on Multilingual Report Generation via Retrieval Augmented Generation (RAG4Reports 2026), pages 71–76, San Diego, CA, USA. Association for Computational Linguistics.