Qiaoyu Tan
Author directory2026
ChronoClinQA: A Longitudinal Multi-Admission Benchmark for Clinical Reasoning over Electronic Health Records
Tong Chen | Zimu Wang | Dongzhe Fan | Luoyao Chen | Haoyi Lian | Yifan Wang | Zhengni Yang | Zhengyong Jiang | Procheta Sen | Wei Wang | Jionglong Su | Qiaoyu Tan
Findings of the Association for Computational Linguistics: EMNLP 2026
Tong Chen | Zimu Wang | Dongzhe Fan | Luoyao Chen | Haoyi Lian | Yifan Wang | Zhengni Yang | Zhengyong Jiang | Procheta Sen | Wei Wang | Jionglong Su | Qiaoyu Tan
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models (LLMs) have shown strong performance on medical question answering benchmarks, yet existing evaluations remain limited in assessing longitudinal clinical reasoning across multiple hospital admissions. We introduce ChronoClinQA, a large-scale benchmark for longitudinal clinical reasoning grounded in multi-admission electronic health records. Built from longitudinal discharge summaries in MIMIC-IV-Note, ChronoClinQA contains 15,067 QA pairs spanning six clinically grounded reasoning dimensions and three complementary question formats: open-ended, adversarial, and unanswerable multiple-choice questions. Each instance requires reasoning over temporally accumulated patient trajectories, with contexts averaging over 16K tokens across up to eight hospital admissions. Experiments on both general-purpose and medical LLMs reveal substantial performance degradation in longitudinal and adversarial settings, highlighting persistent challenges in integrating cross-admission evidence and in temporal clinical reasoning. Our findings position ChronoClinQA as a challenging benchmark for advancing clinically grounded long-context reasoning in medical LLMs.
SinoGlyphBench: A Diagnostic Benchmark for Chinese Glyph-Level Obfuscation in Language-Model Moderation
Yifan Wang | Zimu Wang | Suliu Qin | Changyu Zeng | Tong Chen | Siqi Chen | Yijie Lin | Lingyu Jiang | Jionglong Su | Yushan Pan | Haiyang Zhang | Wei Wang | Qiaoyu Tan
Findings of the Association for Computational Linguistics: EMNLP 2026
Yifan Wang | Zimu Wang | Suliu Qin | Changyu Zeng | Tong Chen | Siqi Chen | Yijie Lin | Lingyu Jiang | Jionglong Su | Yushan Pan | Haiyang Zhang | Wei Wang | Qiaoyu Tan
Findings of the Association for Computational Linguistics: EMNLP 2026
Glyph-level obfuscation can leave harmful Chinese content readable to humans while degrading automated moderation. We introduce SinoGlyphBench, a diagnostic benchmark that identifies label-critical semantic anchors and creates matched original and glyph-obfuscated inputs in text and image modalities. By perturbing anchors, background context, or both, this design distinguishes corruption of moderation-relevant evidence from general surface variation. Across 176,916 paired evaluations of 12 LLMs and MLLMs, obfuscation increases harmful false-negative and false-positive rates by 6.1 and 4.7 percentage points, respectively, and reduces four-way accuracy by 5.0 points. Models retain 75.7% of the decisions that were correct on the matched original inputs. Full-scope perturbations cause the largest degradation, anchor-only perturbations are more damaging than background-only perturbations, and cross-script substitution is particularly difficult in the text modality. Analysis of structured outputs identifies observable mismatches in visible-form reading, intended-message recovery, and final safety judgment. The evaluated models, therefore, remain brittle to Chinese content written with non-canonical glyphs. Resources are available at https://github.com/fengshun124/SinoGlyphBench.
GraphRAG-Router: Learning Cost-Efficient Routing over GraphRAGs and LLMs with Reinforcement Learning
Dongzhe Fan | Chuanhao Ji | Zimu Wang | Tong Chen | Qiaoyu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Dongzhe Fan | Chuanhao Ji | Zimu Wang | Tong Chen | Qiaoyu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Graph-based retrieval-augmented generation (GraphRAG) has recently emerged as a powerful paradigm for knowledge-intensive question answering, especially for tasks that require structured evidence organization and multi-hop reasoning. However, existing GraphRAG systems are typically built in a one-size-fits-all manner, relying on a fixed retrieval framework and a single, often large and costly, generator LLM for all queries. This static design limits their ability to adapt to the complexity of varying questions and often incurs unnecessary computational cost. To fill in the gap, we propose GraphRAG-Router, a cost-efficient framework that adopts a hierarchical routing strategy to coordinate heterogeneous GraphRAGs and generator LLMs. Specifically, GraphRAG-Router is first warmed up through supervised fine-tuning and then optimized with a two-stage reinforcement learning procedure, whose second stage introduces a curriculum cost-aware reward to encourage difficulty-aware and economical generator allocation. Extensive experiments on six general-domain and multi-hop QA benchmarks show that GraphRAG-Router consistently outperforms state-of-the-art baselines, reducing the overuse of large LLMs by nearly 30% while maintaining strong generalization capability.
GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models
Yuanfu Sun | Yuanhang Ren | Kang Li | Chuanhao Ji | Jiaxi Li | Jiajin Liu | Ninghao Liu | Qiaoyu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuanfu Sun | Yuanhang Ren | Kang Li | Chuanhao Ji | Jiaxi Li | Jiajin Liu | Ninghao Liu | Qiaoyu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse vision-language tasks, creating an urgent need for more challenging benchmarks. Yet existing evaluations still provide limited insight into whether these models can truly reason over structured visual information. Visual Graph Reasoning (VGR) offers a compelling testbed for this challenge, requiring models to integrate perception, structural understanding, and multi-step reasoning over graph-based visual inputs. However, prior VGR benchmarks often reduce the task to visual perception followed by text-based reasoning, restrict evaluation to single-image settings, rely on answer-only metrics, and underrepresent realistic graph-centric scenarios. To bridge the gap, we introduce GraphVerse, a unified benchmark that jointly evaluates perception, visual reasoning, and text-based graph reasoning in MLLMs under both single-image and paired-image settings. At its core is a suite of Graph-centric Image Editing (GIE) strategies that modify graph images while preserving their semantics, turning them into active tests of visual reasoning. We further propose VGR-Score, a process-sensitive metric that evaluates reasoning quality beyond final-answer accuracy. Extensive experiments reveal several key limitations of current MLLMs in VGR, while also validating the effectiveness of GIE strategies and the transferability of GraphVerse to broader multimodal reasoning capabilities. The code is available at https://github.com/sunyuanfu/GraphVerse.
One Model, Many Graphs: Learning over Attributed Graphs across Heterogeneous Modalities with Vision-Language Models
Jiayi Yang | Yifang Chen | Yuanfu Sun | Jiajin Liu | Qiaoyu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jiayi Yang | Yifang Chen | Yuanfu Sun | Jiajin Liu | Qiaoyu Tan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Vision-language models (VLMs) provide a unified representation space for textual and visual information, yet their potential as general-purpose backbones for graph-structured data remains largely unexplored. In practice, attributed graphs exhibit substantial modality heterogeneity: some graphs contain only textual node attributes, others only visual attributes, while still others provide both. Existing graph learning approaches are typically designed for fixed modality schemas, requiring separate models for different settings and limiting scalability and cross-graph generalization. To bridge this gap, we present OMG-VLM (One Model, Many Graphs with Vision-Language Models), a unified framework for learning over attributed graphs across heterogeneous modality schemas. OMG-VLM leverages a pretrained VLM as a shared backbone and introduces structure-aware graph adapters that integrate neighborhood information while remaining compatible with the VLM’s native embedding space. This design enables effective learning over text-attributed, image-attributed, and multimodal-attributed graphs within a single model. Extensive experiments across diverse domains show that OMG-VLM consistently outperforms state-of-the-art GNN- and LLM-based baselines on attributed graph learning tasks such as node classification and link prediction, while exhibiting strong generalization to unseen graphs and varying modality schemas. The source code is available at https://github.com/Jo-eyang/OMG-VLM.
AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning
Yuanfu Sun | Kang Li | Dongzhe Fan | Jiajin Liu | Qiaoyu Tan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yuanfu Sun | Kang Li | Dongzhe Fan | Jiajin Liu | Qiaoyu Tan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Models (LLMs) increasingly rely on agentic capabilities—iterative retrieval, tool use, and decision-making—to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as unstructured text and fail to leverage the topological dependencies inherent in real-world data. To bridge this gap, we introduce Agentic Graph Learning (AGL), a paradigm that reframes graph learning as an interleaved process of topology-aware navigation and LLM-based inference. Specifically, we propose AgentGL, the first reinforcement learning (RL)–driven framework for AGL. AgentGL equips an LLM agent with graph-native tools for multi-scale exploration, regulates tool usage via search-constrained thinking to balance accuracy and efficiency, and employs a graph-conditioned curriculum RL strategy to stabilize long-horizon policy learning without step-wise supervision. Across diverse Text-Attributed Graph (TAG) benchmarks and multiple LLM backbones, AgentGL substantially outperforms strong GraphLLMs and GraphRAG baselines, achieving absolute improvements of up to 17.5% in node classification and 28.4% in link prediction. These results demonstrate that AGL is a promising frontier for enabling LLMs to autonomously navigate and reason over complex relational environments. The code is publicly available at https://github.com/sunyuanfu/AgentGL.
2025
GraphICL: Unlocking Graph Learning Potential in LLMs through Structured Prompt Design
Yuanfu Sun | Zhengnan Ma | Yi Fang | Jing Ma | Qiaoyu Tan
Findings of the Association for Computational Linguistics: NAACL 2025
Yuanfu Sun | Zhengnan Ma | Yi Fang | Jing Ma | Qiaoyu Tan
Findings of the Association for Computational Linguistics: NAACL 2025
The growing importance of textual and relational systems has driven interest in enhancing large language models (LLMs) for graph-structured data, particularly Text-Attributed Graphs (TAGs), where samples are represented by textual descriptions interconnected by edges. While research has largely focused on developing specialized graph LLMs through task-specific instruction tuning, a comprehensive benchmark for evaluating LLMs solely through prompt design remains surprisingly absent. Without such a carefully crafted evaluation benchmark, most if not all, tailored graph LLMs are compared against general LLMs using simplistic queries (e.g., zero-shot reasoning with LLaMA), which can potentially camouflage many advantages as well as unexpected predicaments of them. To achieve more general evaluations and unveil the true potential of LLMs for graph tasks, we introduce Graph In-context Learning (GraphICL) Benchmark, a comprehensive benchmark comprising novel prompt templates designed to capture graph structure and handle limited label knowledge. Our systematic evaluation shows that general-purpose LLMs equipped with our GraphICL outperform state-of-the-art specialized graph LLMs and graph neural network models in resource-constrained settings and out-of-domain tasks. These findings highlight the significant potential of prompt engineering to enhance LLM performance on graph learning tasks without training and offer a strong baseline for advancing research in graph LLMs.
CrystalICL: Enabling In-Context Learning for Crystal Generation
Ruobing Wang | Qiaoyu Tan | Yili Wang | Ying Wang | Xin Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Ruobing Wang | Qiaoyu Tan | Yili Wang | Ying Wang | Xin Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Designing crystal materials with desired physicochemical properties remains a fundamental challenge in materials science. While large language models (LLMs) have demonstrated strong in-context learning (ICL) capabilities, existing LLM-based crystal generation approaches are limited to zero-shot scenarios and are unable to benefit from few-shot scenarios. In contrast, human experts typically design new materials by modifying relevant known structures which aligns closely with the few-shot ICL paradigm. Motivated by this, we propose CrystalICL, a novel model designed for few-shot crystal generation. Specifically, we introduce a space-group based crystal tokenization method, which effectively reduces the complexity of modeling crystal symmetry in LLMs. We further introduce a condition-structure aware hybrid instruction tuning framework and a multi-task instruction tuning strategy, enabling the model to better exploit ICL by capturing structure-property relationships from limited data. Extensive experiments on four crystal generation benchmarks demonstrate the superiority of CrystalICL over the leading baseline methods on conditional and unconditional generation tasks.
2024
Reasoning Like a Doctor: Improving Medical Dialogue Systems via Diagnostic Reasoning Process Alignment
Kaishuai Xu | Yi Cheng | Wenjun Hou | Qiaoyu Tan | Wenjie Li
Findings of the Association for Computational Linguistics: ACL 2024
Kaishuai Xu | Yi Cheng | Wenjun Hou | Qiaoyu Tan | Wenjie Li
Findings of the Association for Computational Linguistics: ACL 2024
Medical dialogue systems have attracted significant attention for their potential to act as medical assistants. Enabling these medical systems to emulate clinicians’ diagnostic reasoning process has been the long-standing research focus. Previous studies rudimentarily realized the simulation of clinicians’ diagnostic process by fine-tuning language models on high-quality dialogue datasets. Nonetheless, they overly focus on the outcomes of the clinician’s reasoning process while ignoring their internal thought processes and alignment with clinician preferences. Our work aims to build a medical dialogue system that aligns with clinicians’ diagnostic reasoning processes. We propose a novel framework, Emulation, designed to generate an appropriate response that relies on abductive and deductive diagnostic reasoning analyses and aligns with clinician preferences through thought process modeling. Experimental results on two datasets confirm the efficacy of Emulation. Crucially, our framework furnishes clear explanations for the generated responses, enhancing its transparency in medical consultations.
Search
Fix author
Co-authors
- Yuanfu Sun 4
- Tong Chen 3
- Dongzhe Fan 3
- Jiajin Liu 3
- Zimu Wang 3
- Chuanhao Ji 2
- Kang Li 2
- Jionglong Su 2
- Wei Wang 2
- Yifan Wang 2
- Luoyao Chen 1
- Siqi Chen 1
- Yifang Chen 1
- Yi Cheng 1
- Yi Fang 1
- Wenjun Hou 1
- Lingyu Jiang 1
- Zhengyong Jiang 1
- Jiaxi Li 1
- Wenjie Li 1
- Haoyi Lian 1
- Yijie Lin 1
- Ninghao Liu 1
- Jing Ma 1
- Zhengnan Ma 1
- Yushan Pan 1
- Suliu Qin 1
- Yuanhang Ren 1
- Procheta Sen 1
- Ruobing Wang 1
- Xin Wang 1
- Yili Wang 1
- Ying Wang 1
- Kaishuai Xu 1
- Jiayi Yang 1
- Zhengni Yang 1
- Changyu Zeng 1
- Haiyang Zhang 1