DataCross: A Unified Benchmark and Agent Framework for Cross-Modal Heterogeneous Data Analysis

Ruyi Qi, Zhou Liu, Yang Gu, Zeli Su, Pan Zewei, Xing Chen, Yuanfeng Song, Wangxiaoyue, Wentao Zhang


Abstract
Real-world analysis often requires combining directly queryable structured sources (e.g., SQL and CSV) with evidence preserved only in visual documents, such as scanned reports, invoices, and dashboards. Current analytics agents still focus primarily on structured and textual inputs, leaving this cross-modal setting underexplored. We introduce DataCross, a benchmark and agent framework for heterogeneous, insight-driven data analysis. DataCrossBench contains 200 end-to-end tasks across six fine-grained categories: Fund Analysis, FinTech, Internet Development, Internet Firms, Short-form Drama, and AI Healthcare, grouped into four macro sectors and mixing SQL/CSV/JSON/TXT sources with image-based evidence. The benchmark is built with a human-in-the-loop reverse-synthesis pipeline to preserve cross-source dependency while keeping the target insights verifiable. We further propose DataCrossAgent, which coordinates source-specialized agents through intra-source exploration, source prioritization, cross-source pollination, and Reasoning ReAct (reReAct)-based executable verification. Experiments show that DataCrossBench reveals a difficulty gap for most baselines, especially on vision-dependent Hard tasks, and that DataCrossAgent improves average factuality over vanilla GPT-4o from 0.3291 to 0.4270 (+29.7%) while showing a smaller Easy-to-Hard degradation than several baselines. These results position DataCrossBench as a practical testbed for cross-modal heterogeneous data analysis.
Anthology ID:
2026.findings-emnlp.1229
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
26006–26027
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1229/
DOI:
Bibkey:
Cite (ACL):
Ruyi Qi, Zhou Liu, Yang Gu, Zeli Su, Pan Zewei, Xing Chen, Yuanfeng Song, Wangxiaoyue, and Wentao Zhang. 2026. DataCross: A Unified Benchmark and Agent Framework for Cross-Modal Heterogeneous Data Analysis. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 26006–26027, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DataCross: A Unified Benchmark and Agent Framework for Cross-Modal Heterogeneous Data Analysis (Qi et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1229.pdf