Xiaoyang Wang
Author directoryOther people with similar names: Xiaoyang Wang, Xiaoyang Wang, Xiaoyang Wang
Unverified author pages with similar names: Xiaoyang Wang
2026
SPARK: Skeleton-Guided Reasoning Synthesis from Large-Scale Scientific Literature
Yu Li | Wei Li | Xin Gao | Mengyuan Sun | Xiaoyang Wang | Qizhi Pei | Lijun Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
Yu Li | Wei Li | Xin Gao | Mengyuan Sun | Xiaoyang Wang | Qizhi Pei | Lijun Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
Scientific reasoning remains challenging for open-source models, largely due to the lack of high-quality scientific reasoning data. Existing datasets are often dominated by factual recall or formulaic problem solving, with limited emphasis on mechanism understanding, evidence-grounded reasoning, and hypothesis evaluation. To address this, we introduce **SPARK (Scientific Paper Abstracted Reasoning sKeleton)**, a paper-oriented synthesis framework built on Sci-Base, a large-scale corpus of research papers spanning 10 scientific disciplines. Instead of directly converting papers into question-answer pairs, SPARK treats the claim-evidence-derivation structure of a paper as the fundamental unit of reasoning synthesis. Specifically, SPARK (1) distills each paper into a compact reasoning skeleton capturing its central claims and supporting evidence, enabling self-contained question generation, and (2) synthesizes reasoning tasks from four scientific perspectives: mechanistic reasoning, hypothesis falsification, quantitative derivation, and boundary calibration. A final consistency verification stage further removes unsupported or contradictory outputs. Using this framework, we construct Spark-234K, a scientific reasoning dataset with substantially higher difficulty and diversity than existing resources. Experiments show that Spark-234K consistently outperforms existing scientific reasoning datasets while achieving stronger performance with significantly fewer training samples.
Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs
Yu Li | Xiaoran Shang | Qizhi Pei | Yun Zhu | Xin Gao | Honglin Lin | Zhanping Zhong | Zhuoshi Pan | Zheng Liu | Xiaoyang Wang | Conghui He | Dahua Lin | Feng Zhao | Lijun Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yu Li | Xiaoran Shang | Qizhi Pei | Yun Zhu | Xin Gao | Honglin Lin | Zhanping Zhong | Zhuoshi Pan | Zheng Liu | Xiaoyang Wang | Conghui He | Dahua Lin | Feng Zhao | Lijun Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Post-training data plays a pivotal role in shaping the capabilities of Large Language Models (LLMs), yet datasets are often treated as isolated artifacts, overlooking the systemic connections that underlie their evolution. To disentangle these complex relationships, we introduce the concept of data lineage to the LLM ecosystem and propose an automated multi-agent framework to reconstruct the evolutionary graph of dataset development. Through large-scale lineage analysis, we characterize domain-specific structural patterns, such as vertical refinement in Math-oriented datasets and horizontal aggregation in General-domain corpora. Moreover, we uncover pervasive systemic issues, including structural redundancy induced by implicit dataset intersections and the propagation of benchmark contamination along lineage paths. To demonstrate the practical value of lineage analysis for data construction, we leverage the reconstructed lineage graph to create a lineage-aware diversity-oriented dataset. By anchoring instruction sampling at upstream leaf sources, this approach mitigates downstream homogenization and hidden redundancy, yielding a more diverse post-training corpus. We further highlight lineage-centric analysis as an efficient and robust topological alternative to sample-level dataset comparison for large-scale data ecosystems. By grounding data construction in explicit lineage structures, our work advances post-training data curation toward a more systematic and controllable paradigm.
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch
Zheng Liu | Honglin Lin | Xiaoyang Wang | Xin Gao | Yu Li | Mengzhang Cai | Yun Zhu | Zhanping Zhong | Qizhi Pei | Zhuoshi Pan | Xiaoran Shang | Conghui He | Bin Cui | Wentao Zhang | Lijun Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zheng Liu | Honglin Lin | Xiaoyang Wang | Xin Gao | Yu Li | Mengzhang Cai | Yun Zhu | Zhanping Zhong | Qizhi Pei | Zhuoshi Pan | Xiaoran Shang | Conghui He | Bin Cui | Wentao Zhang | Lijun Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Chart reasoning is a critical capability for Vision Language Models (VLMs). However, the development of open-source models is severely hindered by the lack of high-quality training data. Existing datasets suffer from a dual challenge: synthetic charts are often simplistic and repetitive, while the associated QA pairs are prone to hallucinations and lack the reasoning depth required for complex tasks. To bridge this gap, we propose ChartVerse, a scalable framework designed to synthesize complex charts and reliable reasoning data from scratch. (1) To address the bottleneck of simple patterns, we first introduce Rollout Posterior Entropy (RPE), a novel metric that quantifies chart complexity. Guided by RPE, we develop complexity-aware chart coder to autonomously synthesize diverse, high-complexity charts via executable programs. (2) To guarantee reasoning rigor, we develop truth-anchored inverse QA synthesis. Diverging from standard generation, we adopt an answer-first paradigm: we extract deterministic answers directly from the source code, generate questions conditional on these anchors, and enforce strict consistency verification. To further elevate difficulty and reasoning depth, we filter samples based on model fail-rate and distill high-quality Chain-of-Thought (CoT) reasoning. We curate ChartVerse-SFT-600K and ChartVerse-RL-40K using Qwen3-VL-30B-A3B-Thinking as the teacher. Experimental results demonstrate that ChartVerse-8B achieves state-of-the-art performance, notably surpassing its teacher and rivaling the stronger Qwen3-32B-Thinking.