Boosting Text-to-Chart Retrieval through Synthesized Hierarchical Insights

Yifan Wu, Lutao Yan, Yizhang Zhu, Yenchi Tseng, Yong Wang, Jiannan Wang, Nan Tang, Yuyu Luo


Abstract
Text-to-chart retrieval enables users to locate relevant charts through natural language queries and has emerged as a critical capability in modern business intelligence systems. However, current benchmarks fail to simulate realistic user queries or test deep semantic understanding, leaving a significant evaluation gap. To address this, we introduce CRBench, the first real-world BI-sourced benchmark comprising 21,862 charts and 326 queries, which adopts a Target-and-Distractor paradigm to evaluate discriminative retrieval among highly similar candidates. Benchmarking reveals that existing methods, which rely primarily on visual features, fail to capture the rich analytical semantics of charts. We therefore propose a semantic insights synthesis pipeline that automatically generates three hierarchical levels of insights for alignment training: visual patterns, statistical properties, and practical applications. Using this pipeline, we produce 207,498 insights for 69,166 charts as training data. Leveraging this data, we develop ChartFinder, which significantly outperforms state-of-the-art methods on CRBench, achieving 66.9% NDCG@10 for precise queries (an 11.58% improvement) and an average gain of 5% across fuzzy query metrics.
Anthology ID:
2026.emnlp-main.2098
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
47764–47780
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2098/
DOI:
Bibkey:
Cite (ACL):
Yifan Wu, Lutao Yan, Yizhang Zhu, Yenchi Tseng, Yong Wang, Jiannan Wang, Nan Tang, and Yuyu Luo. 2026. Boosting Text-to-Chart Retrieval through Synthesized Hierarchical Insights. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 47764–47780, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Boosting Text-to-Chart Retrieval through Synthesized Hierarchical Insights (Wu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2098.pdf