Yishan Li
Author directory2026
Writing As Reasoning: Interleaving Drafting and Deepening for Open-Ended Deep Research
Yishan Li | Wentong Chen | Yukun Yan | Mingwei Li | Kunpeng Liu | Xin Cong | Shuo Wang | Zhong Zhang | Yaxi Lu | Zhenghao Liu | Yankai Lin | Zhiyuan Liu | Maosong Sun
Findings of the Association for Computational Linguistics: EMNLP 2026
Yishan Li | Wentong Chen | Yukun Yan | Mingwei Li | Kunpeng Liu | Xin Cong | Shuo Wang | Zhong Zhang | Yaxi Lu | Zhenghao Liu | Yankai Lin | Zhiyuan Liu | Maosong Sun
Findings of the Association for Computational Linguistics: EMNLP 2026
Generating deep research reports requires large-scale information acquisition and the synthesis of insight-driven analyses, posing a major challenge for current language models. Existing methods largely follow a plan-then-write paradigm, whose performance strongly depends on the quality of the initial outline. We propose a Writing As Reasoning Policy (WARP) framework, which enables models to dynamically revise outlines during report writing. In this policy, the agent alternates between Evidence-Based Drafting and Reasoning-Driven Deepening phases, jointly supporting information acquisition, knowledge refinement, and outline updating. We further introduce a Multi-Stage Agentic Training—including cold start, atomic skill RL, and holistic pipeline RL—that enables small models to operate the WARP effectively. Experiments on DeepResearch Bench, DeepConsult, and DeepResearch Gym show that our approach allows small models to surpass leading closed-source systems, particularly with substantial improvements in Insight metric.
2025
RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework
Kunlun Zhu | Yifan Luo | Dingling Xu | Yukun Yan | Zhenghao Liu | Shi Yu | Ruobing Wang | Shuo Wang | Yishan Li | Nan Zhang | Xu Han | Zhiyuan Liu | Maosong Sun
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Kunlun Zhu | Yifan Luo | Dingling Xu | Yukun Yan | Zhenghao Liu | Shi Yu | Ruobing Wang | Shuo Wang | Yishan Li | Nan Zhang | Xu Han | Zhiyuan Liu | Maosong Sun
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Retrieval-Augmented Generation (RAG) is a powerful approach that enables large language models (LLMs) to incorporate external knowledge. However, evaluating the effectiveness of RAG systems in specialized scenarios remains challenging due to the high costs of data construction and the lack of suitable evaluation metrics. This paper introduces RAGEval, a framework designed to assess RAG systems across diverse scenarios by generating high-quality documents, questions, answers, and references through a schema-based pipeline. With a focus on factual accuracy, we propose three novel metrics—Completeness, Hallucination, and Irrelevance—to evaluate LLM-generated responses rigorously. Experimental results show that RAGEval outperforms zero-shot and one-shot methods in terms of clarity, safety, conformity, and richness of generated samples. Furthermore, the use of LLMs for scoring the proposed metrics demonstrates a high level of consistency with human evaluations. RAGEval establishes a new paradigm for evaluating RAG systems in real-world applications. The code and dataset are released at https://github.com/OpenBMB/RAGEval.