UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos

Fangqi Lou, Zhi Yang, Lingfeng Zeng, Zhiheng Jin, Qi Qi, Wei Zhang, Zhenyu Wu, Zhenxiong Yu, Lejie Zhang, Xiaoming Huang, Xiaolong Liang, Zheng Wei, Junbo Zou, Dongpo Cheng, Zhaowei Liu, Xin Guo, Rongjunchen Zhang, Liwen Zhang


Abstract
Multimodal large language models (MLLMs) have shown increasing potential for applications in the financial domain. However, the challenges posed by real-world financial scenarios, including high-information-density, strong noise interference, and cross-modal multi-hop reasoning, go beyond the evaluation scope of existing financial multimodal benchmarks. To this end, we propose UniFinEval, the first unified multimodal financial evaluation benchmark designed for high-density financial information environments, covering three modalities: text, image, and video. UniFinEval abstracts three progressive core scenarios from perception to reasoning and decision-making, and further refines them into six task categories. It contains 5,567 high-quality Chinese and English question–answer (QA) pairs constructed by financial experts. We systematically evaluate 10 mainstream MLLMs under zero-shot and chain-of-thought (CoT) settings. Experimental results show that Gemini-3-Pro achieves the best overall performance, but still exhibits a significant gap compared with financial experts. Further error analysis reveals the capability deficiencies of MLLMs in financial scenarios. UniFinEval aims to systematically evaluate the capabilities of MLLMs in real financial scenarios, thereby promoting the application of MLLMs in the financial domain. The related code and data are available at https://github.com/aifinlab/UniFinEval.
Anthology ID:
2026.findings-emnlp.2075
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44168–44206
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2075/
DOI:
Bibkey:
Cite (ACL):
Fangqi Lou, Zhi Yang, Lingfeng Zeng, Zhiheng Jin, Qi Qi, Wei Zhang, Zhenyu Wu, Zhenxiong Yu, Lejie Zhang, Xiaoming Huang, Xiaolong Liang, Zheng Wei, Junbo Zou, Dongpo Cheng, Zhaowei Liu, Xin Guo, Rongjunchen Zhang, and Liwen Zhang. 2026. UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 44168–44206, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos (Lou et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2075.pdf