Jian Wang
Author directoryOther people with similar names: Jian Wang, Jian Wang, Jian Wang, Jian Wang, Jian Wang (Hong Kong Polytechnic)
Unverified author pages with similar names: Jian Wang
2026
SlimSearcher: Training Efficiency-Aware Web Agents via Adaptive Reward Gating
Zequn Xie | Junjie Wang | Dan Yang | Jie Feng | Yue Shen | Jian Wang | Jinjie Gu
Findings of the Association for Computational Linguistics: EMNLP 2026
Zequn Xie | Junjie Wang | Dan Yang | Jie Feng | Yue Shen | Jian Wang | Jinjie Gu
Findings of the Association for Computational Linguistics: EMNLP 2026
Deep research agents have demonstrated remarkable capabilities in complex information-seeking tasks, yet this power comes at a steep computational cost. Driven by accuracy-focused training paradigms, current models adopt brute-force strategies characterized by blind tool dependency and performative reasoning—generating long, redundant trajectories that are far from necessary for resolving these tasks, leading to wasteful tool calls and excessive token consumption. To overcome this efficiency trap, we propose SlimSearcher, a principled framework that pushes the Pareto frontier between accuracy and computational cost across both Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). In the SFT stage, SlimSearcher employs Pareto-efficient filtration to distill trajectories that are both successful and economical, guiding the model toward inherently efficiency-aware search behaviors. During RL, we introduce Adaptive Reward Gating, a dynamic reward-shaping mechanism that evaluates relative tool and token efficiency within a sampled cohort. By cascading these adaptive efficiency metrics with a strict correctness gate, our approach effectively avoids the brevity bias associated with absolute penalties and mitigates reward hacking. Extensive experiments on long-horizon benchmarks, including GAIA, BrowseComp, and XBench-DeepSearch, demonstrate that SlimSearcher reduces average tool-call rounds by 28%–59% while maintaining or improving accuracy.
ClinAlign: Scaling Healthcare Alignment from Clinician Preference
Shiwei Lyu | Xidong Wang | Hao Zhu | Lei Liu | Chaohe Zhang | Jian Wang | Jinjie Gu | Benyou Wang | Yue Shen
Findings of the Association for Computational Linguistics: ACL 2026
Shiwei Lyu | Xidong Wang | Hao Zhu | Lei Liu | Chaohe Zhang | Jian Wang | Jinjie Gu | Benyou Wang | Yue Shen
Findings of the Association for Computational Linguistics: ACL 2026
Although large language models (LLMs) demonstrate expert-level medical knowledge, aligning their open-ended outputs with fine-grained clinician preferences remains challenging. Existing methods often rely on coarse objectives or unreliable automated judges that are weakly grounded in professional guidelines. We propose a two-stage framework to address this gap. First, we introduce HealthRubrics, a dataset of 7,034 physician-verified preference examples in which clinicians refine LLM-drafted rubrics to meet rigorous medical standards. Second, we distill these rubrics into HealthPrinciples: 119 broadly reusable, clinically grounded principles organized by clinical dimensions, enabling scalable supervision beyond manual annotation. We use HealthPrinciples for (1) offline alignment by synthesizing rubrics for unlabeled queries and (2) an inference-time tool for guided self-revision. A 30A3B model with our framework achieves 33.4% on HealthBench-Hard, outperforming much larger models including Deepseek-R1 and o3, establishing a resource-efficient baseline for clinical alignment.
GroupRank: A Groupwise Paradigm for Effective and Efficient Passage Reranking with LLMs
Meixiu Long | Duolin Sun | Dan Yang | Yihan Jiao | Lei Liu | Jiahai Wang | Binbin Hu | Yue Shen | Jie Feng | Zhehao Tan | Junjie Wang | Lianzhen Zhong | Jian Wang | Peng Wei | Jinjie Gu
Findings of the Association for Computational Linguistics: ACL 2026
Meixiu Long | Duolin Sun | Dan Yang | Yihan Jiao | Lei Liu | Jiahai Wang | Binbin Hu | Yue Shen | Jie Feng | Zhehao Tan | Junjie Wang | Lianzhen Zhong | Jian Wang | Peng Wei | Jinjie Gu
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models (LLMs) have emerged as powerful tools for passage reranking in information retrieval, leveraging their superior reasoning capabilities to address the limitations of conventional models on complex queries. However, current LLM-based reranking paradigms are fundamentally constrained by an efficiency-accuracy trade-off: (1) pointwise methods are efficient but ignore inter-document comparison, yielding suboptimal accuracy; (2) listwise methods capture global context but suffer from context-window constraints and prohibitive inference latency. To address these issues, we propose GroupRank, a novel paradigm that balances flexibility and context awareness. To unlock the full potential of groupwise reranking, we propose an answer-free data synthesis pipeline that fuses local pointwise signals with global listwise rankings. These samples facilitate supervised fine-tuning and reinforcement learning, with the latter guided by a specialized group-ranking reward comprising ranking-utility and group-alignment. These complementary components synergistically optimize document ordering and score calibration to reflect intrinsic query-document relevance.Experimental results show GroupRank achieves a state-of-the-art 65.2 NDCG@10 on BRIGHT and surpasses baselines by 2.1 points on R2MED, while delivering a 6.4× inference speedup. The code is available at https://github.com/AQ-MedAI/Diver/tree/main/Reranker/GroupRank.
EHR-Complex: Benchmarking Medical Agents for Complex Clinical Reasoning
Yitong Qiao | Lei Liu | Yue Shen | Jian Wang | Jinjie Gu | Zhixuan Chu | Kui Ren
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yitong Qiao | Lei Liu | Yue Shen | Jian Wang | Jinjie Gu | Zhixuan Chu | Kui Ren
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Clinical agents promise to democratize access to electronic health records (EHRs), yet existing benchmarks fail to reflect the complexity of practical EHR analysis, e.g., often operating on idealized, clean EHRs via static SQL generation rather than interactive execution. In this work, we introduce **EHR-Complex**, a large-scale benchmark designed for interactive clinical database reasoning. Built on the large MIMIC-IV substrate (365K patients, 31 tables, 500M+ records), EHR-Complex comprises about 52K tasks spanning six clinical intents, supporting both patient-level and population-level queries, where each task requires an agent to interact with a sandboxed environment by executing SQL queries or Python code. Notably, EHR-Complex considers the real-world SQL task complexity for longitudinal multi-table aggregation and compositional reasoning, resulting in 31.93 SQL structural components per query on average. Evaluation results on EHR-Complex reveal the clinical difficulty of these EHR reasoning scenarios, with the top-performing model achieving only 62.3% exact-match accuracy. Pass^k consistency drops below 50% for nearly all evaluated models at k=4, exposing broad stochastic fragility. A fine-grained analysis of more than 3,800 failed trajectories for representative LLMs reveals three dominant failure modes: SQL logic errors, medical-code lookup failures, and semantic misunderstandings. EHR-Complex provides a rigorous testbed for clinical agents and highlights remaining gaps in robust reasoning for large-scale EHR analysis.
Towards Fluid Consultations: Design and Real-World Evaluation of a Multi-Agent, Full-Duplex Health AI Assistant
Zhoujian Sun | Minghui Yang | Jian Wang | Jinjie Gu | Junwei Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Zhoujian Sun | Minghui Yang | Jian Wang | Jinjie Gu | Junwei Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Access to reliable health consultation is a critical global challenge. While large language models show promise, their practical utility is typically limited by high input barriers, lack of adaptive response strategies for complex scenarios, and insufficient real-world evaluation. To address these gaps, we present a novel health AI assistant that integrates a low-latency full-duplex voice interface with a Multi-Agent System (MAS). The full-duplex design supports natural turn-taking, significantly lowering interaction barriers and quadrupling average conversation depth from 2.62 to 10.16 turns compared to text-based baselines. Furthermore, our MAS architecture decouples clinical reasoning from general conversation, effectively managing complex queries and boosting clinical performance scores by over 30% compared to single-agent baselines. We conducted the first large-scale analysis of an LLM-based health assistant deployed to the general public (N > 5,000), demonstrating superior user engagement and providing empirical evidence on the safety and utility of deploying such systems in realistic environments.
Perplexity-Aware Data Scaling Law: Perplexity Landscapes Predict Performance for Continual Pre-training
Lei Liu | Hao Zhu | Xiaoyan Yang | Yue Shen | Zhixuan Chu | Jian Wang | Jinjie Gu | Kui Ren
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Lei Liu | Hao Zhu | Xiaoyan Yang | Yue Shen | Zhixuan Chu | Jian Wang | Jinjie Gu | Kui Ren
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Continual Pre-training (CPT) serves as a fundamental approach for adapting foundation models to domain-specific applications. Scaling laws for pre-training define a power-law relationship between dataset size and the test loss of an LLM. However, the marginal gains from simply increasing data for CPT diminish rapidly, yielding suboptimal data utilization and inefficient training. To address this challenge, we propose a novel perplexity-aware data scaling law to establish a predictive relationship between the perplexity landscape of domain-specific data and the test loss. Our approach leverages the pre-trained model’s own perplexity on domain data as a proxy for estimating the knowledge gap, effectively quantifying the informational perplexity landscape of candidate training samples. By fitting this scaling law across diverse perplexity regimes, we enable adaptive selection of high-utility data subsets, prioritizing content that maximizes knowledge absorption while minimizing redundancy and noise. Extensive experiments on both medical and general-domain benchmarks demonstrate that our method consistently identifies near-optimal training subsets, achieving superior performance with significantly reduced data consumption.
WebClipper: Efficient Evolution of Web Agents with Graph-based Trajectory Pruning
Junjie Wang | Zequn Xie | Dan Yang | Jie Feng | Yue Shen | Duolin Sun | Meixiu Long | Yihan Jiao | Zhehao Tan | Jian Wang | Peng Wei | Jinjie Gu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Junjie Wang | Zequn Xie | Dan Yang | Jie Feng | Yue Shen | Duolin Sun | Meixiu Long | Yihan Jiao | Zhehao Tan | Jian Wang | Peng Wei | Jinjie Gu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Deep Research systems based on web agents have shown strong potential in solving complex information-seeking tasks, yet their search efficiency remains underexplored. We observe that many state-of-the-art open-source web agents rely on long tool-call trajectories with cyclic reasoning loops and exploration of unproductive branches. To address this, we propose WebClipper, a framework that compresses web agent trajectories via graph-based pruning. Concretely, we model the agent’s search process as a state graph and cast trajectory optimization as a minimum-necessary Directed Acyclic Graph (DAG) mining problem, yielding pruned trajectories that preserve essential reasoning while eliminating redundant steps. Continued training on these refined trajectories enables the agent to evolve toward more efficient search patterns and reduces tool-call rounds by about 20% while improving accuracy. Furthermore, we introduce a new metric called F-AE Score to measure the model’s overall performance in balancing accuracy and efficiency. Experiments demonstrate that WebClipper compresses tool-call rounds under excellent performance, providing practical insight into balancing effectiveness and efficiency in web agent design.
2025
HIRAG: Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation
Yihan Jiao | Zhehao Tan | Dan Yang | Duolin Sun | Jie Feng | Yue Shen | Jian Wang | Peng Wei
Findings of the Association for Computational Linguistics: EMNLP 2025
Yihan Jiao | Zhehao Tan | Dan Yang | Duolin Sun | Jie Feng | Yue Shen | Jian Wang | Peng Wei
Findings of the Association for Computational Linguistics: EMNLP 2025
Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems primarily rely on the in-context learning (ICL) capabilities of the large language model itself. Still, in-depth research on the specific capabilities needed by the RAG generation model is lacking, leading to challenges with inconsistent document quality and retrieval system imperfections. Even the limited studies that fine-tune RAG generative models often lack a granular focus on RAG tasks or a deeper utilization of chain-of-thought processes. To address this, we propose that RAG models should possess three progressively hierarchical abilities (1) Filtering: the ability to select relevant information; (2) Combination: the ability to combine semantic information across paragraphs; and (3) RAG-specific reasoning: the ability to further process external knowledge using internal knowledge. Thus, we introduce our new RAG instruction fine-tuning method, Hierarchical-Thought Instruction-Tuning Retrieval-Augmented Generation (HIRAG) incorporates a “think before answering” strategy. This method enhances the model’s open-book examination capability by utilizing multi-level progressive chain-of-thought. Experiments show that the HIRAG training strategy significantly improves the model’s performance on datasets such as RGB, PopQA, MuSiQue, HotpotQA, and PubmedQA.