Jingchao Wang
Author directoryOther people with similar names: Jingchao Wang
2026
RxnExBench: Benchmarking Vision-Language Models for Structured Chemical Reaction Extraction from Scientific Literature
Jiaxing Sun | Junyuan Gao | Ruikang Zhang | Hao Zheng | Lingli Ge | Xiao An | Jiang Wu | Huazheng Zeng | Jiahe Song | Chen Zhu | Haote Yang | Jingchao Wang | Lu Chen | Yuanyuan Cao | Ruijie Zhang | Shengxin Lu | Weijia Li | Lijun Wu | Conghui He
Findings of the Association for Computational Linguistics: EMNLP 2026
Jiaxing Sun | Junyuan Gao | Ruikang Zhang | Hao Zheng | Lingli Ge | Xiao An | Jiang Wu | Huazheng Zeng | Jiahe Song | Chen Zhu | Haote Yang | Jingchao Wang | Lu Chen | Yuanyuan Cao | Ruijie Zhang | Shengxin Lu | Weijia Li | Lijun Wu | Conghui He
Findings of the Association for Computational Linguistics: EMNLP 2026
Screen Tables and Substrate Scopes are information-dense figures widely used in synthetic chemistry literature, yet automated extraction of structured reaction data from them remains challenging. We introduce RxnExBench, a multimodal benchmark for fine-grained reaction-level evaluation. Built from high-impact chemistry journals, it contains 3,565 expert-annotated reactions and 2,361 canonical molecular structures. The dataset adopts a unified schema with 15 reaction roles and 26 core fields, supporting downstream AI-for-Chemistry tasks such as retrosynthetic planning, yield prediction, and reaction condition recommendation. RxnExBench further provides a reasoning-driven difficulty taxonomy, a modular annotation pipeline, and the Oracle-MolRec protocol, which disentangles molecular recognition from higher-level reasoning. Evaluation of 9 state-of-the-art VLMs shows that performance degrades substantially as schema complexity and reasoning demands increase. Under the Oracle-MolRec setting, results further reveal that accurate molecular recognition alone is insufficient, with multimodal integration and chemistry-aware reasoning remaining the primary bottlenecks. We release all data and code to facilitate future research in chemistry-aware multimodal understanding and AI-for-Chemistry dataset construction.
2025
OpenHuEval: Evaluating Large Language Model on Hungarian Specifics
Haote Yang | Xingjian Wei | Jiang Wu | Noémi Ligeti-Nagy | Jiaxing Sun | Yinfan Wang | Zijian Győző Yang | Junyuan Gao | Jingchao Wang | Bowen Jiang | Shasha Wang | Nanjun Yu | Zihao Zhang | Shixin Hong | Hongwei Liu | Wei Li | Songyang Zhang | Dahua Lin | Lijun Wu | Gábor Prószéky | Conghui He
Findings of the Association for Computational Linguistics: ACL 2025
Haote Yang | Xingjian Wei | Jiang Wu | Noémi Ligeti-Nagy | Jiaxing Sun | Yinfan Wang | Zijian Győző Yang | Junyuan Gao | Jingchao Wang | Bowen Jiang | Shasha Wang | Nanjun Yu | Zihao Zhang | Shixin Hong | Hongwei Liu | Wei Li | Songyang Zhang | Dahua Lin | Lijun Wu | Gábor Prószéky | Conghui He
Findings of the Association for Computational Linguistics: ACL 2025
We introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics. OpenHuEval is constructed from a vast collection of Hungarian-specific materials sourced from multiple origins. In the construction, we incorporated the latest design principles for evaluating LLMs, such as using real user queries from the internet, emphasizing the assessment of LLMs’ generative capabilities, and employing LLM-as-judge to enhance the multidimensionality and accuracy of evaluations. Ultimately, OpenHuEval encompasses eight Hungarian-specific dimensions, featuring five tasks and 3953 questions. Consequently, OpenHuEval provides the comprehensive, in-depth, and scientifically accurate assessment of LLM performance in the context of the Hungarian language and its specifics. We evaluated current mainstream LLMs, including both traditional LLMs and recently developed Large Reasoning Models. The results demonstrate the significant necessity for evaluation and model optimization tailored to the Hungarian language and specifics. We also established the framework for analyzing the thinking processes of LRMs with OpenHuEval, revealing intrinsic patterns and mechanisms of these models in non-English languages, with Hungarian serving as a representative example. We will release OpenHuEval at https://github.com/opendatalab/OpenHuEval .
Search
Fix author
Co-authors
- Junyuan Gao 2
- Conghui He 2
- Jiaxing Sun 2
- Jiang Wu 2
- Lijun Wu 2
- Haote Yang 2
- Xiao An 1
- Yuanyuan Cao 1
- Lu Chen 1
- Lingli Ge 1
- Shixin Hong 1
- Bowen Jiang 1
- Wei Li 1
- Weijia Li 1
- Noémi Ligeti-Nagy 1
- Dahua Lin 1
- Hongwei Liu 1
- Shengxin Lu 1
- Gabor Proszeky 1
- Jiahe Song 1
- Shasha Wang 1
- Yinfan Wang 1
- Xingjian Wei 1
- Zijian Győző Yang 1
- Nanjun Yu 1
- Huazheng Zeng 1
- Ruijie Zhang 1
- Ruikang Zhang 1
- Songyang Zhang 1
- Zihao Zhang 1
- Hao Zheng 1
- Chen Zhu 1