Qi Qi
Author directoryOther people with similar names: Qi Qi, Qi Qi, Qi Qi
Unverified author pages with similar names: Qi Qi
2026
UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos
Fangqi Lou | Zhi Yang | Lingfeng Zeng | Zhiheng Jin | Qi Qi | Wei Zhang | Zhenyu Wu | Zhenxiong Yu | Lejie Zhang | Xiaoming Huang | Xiaolong Liang | Zheng Wei | Junbo Zou | Dongpo Cheng | Zhaowei Liu | Xin Guo | Rongjunchen Zhang | Liwen Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Fangqi Lou | Zhi Yang | Lingfeng Zeng | Zhiheng Jin | Qi Qi | Wei Zhang | Zhenyu Wu | Zhenxiong Yu | Lejie Zhang | Xiaoming Huang | Xiaolong Liang | Zheng Wei | Junbo Zou | Dongpo Cheng | Zhaowei Liu | Xin Guo | Rongjunchen Zhang | Liwen Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Multimodal large language models (MLLMs) have shown increasing potential for applications in the financial domain. However, the challenges posed by real-world financial scenarios, including high-information-density, strong noise interference, and cross-modal multi-hop reasoning, go beyond the evaluation scope of existing financial multimodal benchmarks. To this end, we propose UniFinEval, the first unified multimodal financial evaluation benchmark designed for high-density financial information environments, covering three modalities: text, image, and video. UniFinEval abstracts three progressive core scenarios from perception to reasoning and decision-making, and further refines them into six task categories. It contains 5,567 high-quality Chinese and English question–answer (QA) pairs constructed by financial experts. We systematically evaluate 10 mainstream MLLMs under zero-shot and chain-of-thought (CoT) settings. Experimental results show that Gemini-3-Pro achieves the best overall performance, but still exhibits a significant gap compared with financial experts. Further error analysis reveals the capability deficiencies of MLLMs in financial scenarios. UniFinEval aims to systematically evaluate the capabilities of MLLMs in real financial scenarios, thereby promoting the application of MLLMs in the financial domain. The related code and data are available at https://github.com/aifinlab/UniFinEval.
2025
VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understanding
Zhaowei Liu | Xin Guo | Haotian Xia | Lingfeng Zeng | Fangqi Lou | Jinyi Niu | Mengping Li | Qi Qi | Jiahuan Li | Wei Zhang | Yinglong Wang | Weige Cai | Weining Shen | Liwen Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Zhaowei Liu | Xin Guo | Haotian Xia | Lingfeng Zeng | Fangqi Lou | Jinyi Niu | Mengping Li | Qi Qi | Jiahuan Li | Wei Zhang | Yinglong Wang | Weige Cai | Weining Shen | Liwen Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Multimodal large language models (MLLMs) hold great promise for automating complex financial analysis. To comprehensively evaluate their capabilities, we introduce VisFinEval, the first large-scale Chinese benchmark that spans the full front-middle-back office lifecycle of financial tasks. VisFinEval comprises 15,848 annotated question–answer pairs drawn from eight common financial image modalities (e.g., K-line charts, financial statements, official seals), organized into three hierarchical scenario depths: Financial Knowledge & Data Analysis, Financial Analysis & Decision Support, and Financial Risk Control & Asset Optimization. We evaluate 21 state-of-the-art MLLMs in a zero-shot setting. The top model, Qwen-VL-max, achieves an overall accuracy of 76.3%, outperforming non-expert humans but trailing financial experts by over 14 percentage points. Our error analysis uncovers six recurring failure modes—including cross-modal misalignment, hallucinations, and lapses in business-process reasoning—that highlight critical avenues for future research. VisFinEval aims to accelerate the development of robust, domain-tailored MLLMs capable of seamlessly integrating textual and visual financial information. The data and the code are available at https://github.com/SUFE-AIFLM-Lab/VisFinEval.