<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="zhu-etal-2026-cfqa">
    <titleInfo>
        <title>CFQA: A Chinese Financial Question Answering Benchmark from Corporate Annual Reports</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Tianning</namePart>
        <namePart type="family">Zhu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mo</namePart>
        <namePart type="family">Liu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Murathan</namePart>
        <namePart type="family">Kurfali</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>The 7th Financial Narrative Processing Workshop</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Mo</namePart>
            <namePart type="family">El-Haj</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Antonio</namePart>
            <namePart type="family">Moreno Sandoval</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ana</namePart>
            <namePart type="family">Garcia-Serrano</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Chung-Chi</namePart>
            <namePart type="family">Chen</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Paul</namePart>
            <namePart type="family">Rayson</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yanco</namePart>
            <namePart type="given">Amor</namePart>
            <namePart type="family">Torterolo Orta</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Paloma</namePart>
            <namePart type="family">Martinez</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jordi</namePart>
            <namePart type="family">Porta</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>European Language Resources Association (ELRA)</publisher>
            <place>
                <placeTerm type="text">Palma de Mallorca, Spain</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We present CFQA, a Chinese financial question answering benchmark constructed from 50 publicly listed companies’ annual reports spanning 2023–2025. The benchmark comprises 500 questions, derived by applying 10 question templates to each source document, and covers five categories: fact extraction, enumeration, comparative calculation, judgment verification, and reasoning analysis. All gold-standard answers are manually annotated and grounded in the source reports. To illustrate benchmark utility, we evaluate a retrieval-augmented generation (RAG) system against a no-retrieval baseline, and introduce a rule-based consistency detector that distinguishes fabricated content from other error types. RAG improves average answer accuracy from 7.53% to 8.07%, with the most consistent gains observed in fact extraction and judgment verification tasks for domain-adapted models. Crucially, by decoupling exact-match accuracy from evidence-support judgments, our detector reveals that despite low absolute scores, RAG architectures successfully constrain model confabulation, exhibiting remarkably low true fabrication rates. However, performance gains in higher-order cognitive tasks, such as comparative calculation and reasoning analysis, remain non-significant across evaluated models, highlighting the boundaries of current retrieval-augmented systems in complex financial reasoning. The dataset, annotation guidelines, and evaluation code are publicly released.</abstract>
    <identifier type="citekey">zhu-etal-2026-cfqa</identifier>
    <identifier type="doi">10.63317/4e6fhrncfrbu</identifier>
    <location>
        <url>https://aclanthology.org/2026.fnp-1.3/</url>
    </location>
    <part>
        <date>2026-05</date>
        <extent unit="page">
            <start>28</start>
            <end>38</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T CFQA: A Chinese Financial Question Answering Benchmark from Corporate Annual Reports
%A Zhu, Tianning
%A Liu, Mo
%A Kurfali, Murathan
%Y El-Haj, Mo
%Y Moreno Sandoval, Antonio
%Y Garcia-Serrano, Ana
%Y Chen, Chung-Chi
%Y Rayson, Paul
%Y Torterolo Orta, Yanco Amor
%Y Martinez, Paloma
%Y Porta, Jordi
%S The 7th Financial Narrative Processing Workshop
%D 2026
%8 May
%I European Language Resources Association (ELRA)
%C Palma de Mallorca, Spain
%F zhu-etal-2026-cfqa
%X We present CFQA, a Chinese financial question answering benchmark constructed from 50 publicly listed companies’ annual reports spanning 2023–2025. The benchmark comprises 500 questions, derived by applying 10 question templates to each source document, and covers five categories: fact extraction, enumeration, comparative calculation, judgment verification, and reasoning analysis. All gold-standard answers are manually annotated and grounded in the source reports. To illustrate benchmark utility, we evaluate a retrieval-augmented generation (RAG) system against a no-retrieval baseline, and introduce a rule-based consistency detector that distinguishes fabricated content from other error types. RAG improves average answer accuracy from 7.53% to 8.07%, with the most consistent gains observed in fact extraction and judgment verification tasks for domain-adapted models. Crucially, by decoupling exact-match accuracy from evidence-support judgments, our detector reveals that despite low absolute scores, RAG architectures successfully constrain model confabulation, exhibiting remarkably low true fabrication rates. However, performance gains in higher-order cognitive tasks, such as comparative calculation and reasoning analysis, remain non-significant across evaluated models, highlighting the boundaries of current retrieval-augmented systems in complex financial reasoning. The dataset, annotation guidelines, and evaluation code are publicly released.
%R 10.63317/4e6fhrncfrbu
%U https://aclanthology.org/2026.fnp-1.3/
%U https://doi.org/10.63317/4e6fhrncfrbu
%P 28-38

Markdown (Informal)

[CFQA: A Chinese Financial Question Answering Benchmark from Corporate Annual Reports](https://aclanthology.org/2026.fnp-1.3/) (Zhu et al., FNP 2026)

• CFQA: A Chinese Financial Question Answering Benchmark from Corporate Annual Reports (Zhu et al., FNP 2026)

ACL

• Tianning Zhu, Mo Liu, and Murathan Kurfali. 2026. CFQA: A Chinese Financial Question Answering Benchmark from Corporate Annual Reports. In The 7th Financial Narrative Processing Workshop, pages 28–38, Palma de Mallorca, Spain. European Language Resources Association (ELRA).