Taolin Zhang
Author directoryOther people with similar names: Taolin Zhang
Unverified author pages with similar names: Taolin Zhang
2026
CompassJudger-2: A Holistic Approach Towards Generalist Judge Model
Taolin Zhang | Zihan Ma | Maosongcao | Shudong Liu | Junnan Liu | Songyang Zhang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Taolin Zhang | Zihan Ma | Maosongcao | Shudong Liu | Junnan Liu | Songyang Zhang | Kai Chen
Findings of the Association for Computational Linguistics: EMNLP 2026
Recently, the role of LLM-as-judge in evaluating large language models has gained prominence, emerging as an important method to partially replace costly human assessment. However, current judge models suffer from narrow specialization and limited robustness, undermining their capacity for comprehensive evaluations. In this work, we decompose the ability of a generalist and generative judge model into three levels: objective verification, subjective evaluation, and rubric refinement. We present CompassJudger-2, a novel generalist judge model that overcomes these limitations via a task-driven, multi-scenarios data curation strategy. We conducted large-scale data collection for each type of task and designed tailored rejection sampling strategies to filter the data, ensuring data diversity, accuracy, and effectiveness. Empirically, CompassJudger-2 achieves superior results across multiple judge and reward benchmarks, demostrating its excellent robustness and generalization ability. These contributions advance robust, scalable LLM judgment and establish new performance and evaluation standards.
2025
Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
Maosong Cao | Taolin Zhang | Mo Li | Chuyu Zhang | Yunxin Liu | Haodong Duan | Songyang Zhang | Kai Chen
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Maosong Cao | Taolin Zhang | Mo Li | Chuyu Zhang | Yunxin Liu | Haodong Duan | Songyang Zhang | Kai Chen
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The quality of Supervised Fine-Tuning (SFT) data plays a critical role in enhancing the conversational capabilities of Large Language Models (LLMs). However, the availability of high-quality human-annotated SFT data has become a significant bottleneck for LLMs, necessitating a greater reliance on synthetic training data. In this work, we introduce Condor, a two-stage synthetic data generation framework that incorporates World Knowledge Trees and Self-Reflection Refinement to produce high-quality SFT data at scale. Our experimental results demonstrate that a base model fine-tuned on only 20K Condor-generated samples achieves superior performance compared to instruct model trained with RLHF. The additional refinement stage in Condor further enables iterative self-improvement for LLMs at various scales (up to 72B), validating the effectiveness of our approach. Furthermore, our investigation into the scaling of synthetic data in post-training reveals substantial unexplored potential for performance improvements, opening promising avenues for future research.