Bingchen Zhao
Author directory2026
AutoData: Agentic Search for Pre-training Data Selection
Yan Meng | Dhruv Srikanth | Bingchen Zhao | Zhengyao Jiang | Yuxiang Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
Yan Meng | Dhruv Srikanth | Bingchen Zhao | Zhengyao Jiang | Yuxiang Wu
Findings of the Association for Computational Linguistics: EMNLP 2026
LLM agents have recently shown promise in automating machine learning engineering by editing model and training code under execution feedback. Data, however, remains largely outside this agentic optimisation loop. We frame pre-training data selection as heuristic engineering over per-document features, i.e., lexical statistics, categorical labels, and perplexity. We introduce AutoData, an agent that searches directly over executable selection algorithms. Unlike prior data mixture methods that optimise weights over a fixed set of domains, AutoData searches a richer program space of scoring, stratification, and stochastic selection rules, discovering feature interactions automatically by iteratively refining algorithms with validation feedback from a proxy model. Within an overnight search, AutoData discovers a selection algorithm that outperforms existing human-designed curation pipelines. Despite being searched only on this small proxy, the discovered recipe transfers to larger scales and improves the downstream metric CORE. These results suggest that data engineering can be treated as an agentic machine learning problem, extending autonomous research from model and training-code optimization to the data.
2025
Libra-Leaderboard: Towards Responsible AI through a Balanced Leaderboard of Safety and Capability
Haonan Li | Xudong Han | Zenan Zhai | Honglin Mu | Hao Wang | Zhenxuan Zhang | Yilin Geng | Shom Lin | Renxi Wang | Artem Shelmanov | Xiangyu Qi | Yuxia Wang | Donghai Hong | Youliang Yuan | Meng Chen | Haoqin Tu | Fajri Koto | Cong Zeng | Tatsuki Kuribayashi | Rishabh Bhardwaj | Bingchen Zhao | Yawen Duan | Yi Liu | Emad A. Alghamdi | Yaodong Yang | Yinpeng Dong | Soujanya Poria | Pengfei Liu | Zhengzhong Liu | Hector Xuguang Ren | Eduard Hovy | Iryna Gurevych | Preslav Nakov | Monojit Choudhury | Timothy Baldwin
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (System Demonstrations)
Haonan Li | Xudong Han | Zenan Zhai | Honglin Mu | Hao Wang | Zhenxuan Zhang | Yilin Geng | Shom Lin | Renxi Wang | Artem Shelmanov | Xiangyu Qi | Yuxia Wang | Donghai Hong | Youliang Yuan | Meng Chen | Haoqin Tu | Fajri Koto | Cong Zeng | Tatsuki Kuribayashi | Rishabh Bhardwaj | Bingchen Zhao | Yawen Duan | Yi Liu | Emad A. Alghamdi | Yaodong Yang | Yinpeng Dong | Soujanya Poria | Pengfei Liu | Zhengzhong Liu | Hector Xuguang Ren | Eduard Hovy | Iryna Gurevych | Preslav Nakov | Monojit Choudhury | Timothy Baldwin
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (System Demonstrations)
As large language models (LLMs) continue to evolve, leaderboards play a significant role in steering their development. Existing leaderboards often prioritize model capabilities while overlooking safety concerns, leaving a significant gap in responsible AI development. To address this gap, we introduce Libra-Leaderboard, a comprehensive framework designed to rank LLMs through a balanced evaluation of performance and safety. Combining a dynamic leaderboard with an interactive LLM arena, Libra-Leaderboard encourages the joint optimization of capability and safety. Unlike traditional approaches that average performance and safety metrics, Libra-Leaderboard uses a distance-to-optimal-score method to calculate the overall rankings. This approach incentivizes models to achieve a balance rather than excelling in one dimension at the expense of some other ones. In the first release, Libra-Leaderboard evaluates 26 mainstream LLMs from 14 leading organizations, identifying critical safety challenges even in state-of-the-art models.
Search
Fix author
Co-authors
- Emad A. Alghamdi 1
- Timothy Baldwin 1
- Rishabh Bhardwaj 1
- Meng Chen 1
- Monojit Choudhury 1
- Yinpeng Dong 1
- Yawen Duan 1
- Yilin Geng 1
- Iryna Gurevych 1
- Xudong Han 1
- Donghai Hong 1
- Eduard Hovy 1
- Zhengyao Jiang 1
- Fajri Koto 1
- Tatsuki Kuribayashi 1
- Haonan Li 1
- Shom Lin 1
- Pengfei Liu 1
- Yi Liu 1
- Zhengzhong Liu 1
- Yan Meng 1
- Honglin Mu 1
- Preslav Nakov 1
- Soujanya Poria 1
- Xiangyu Qi 1
- Hector Xuguang Ren 1
- Artem Shelmanov 1
- Dhruv Srikanth 1
- Haoqin Tu 1
- Hao Wang 1
- Renxi Wang 1
- Yuxia Wang 1
- Yuxiang Wu 1
- Yaodong Yang (杨耀东) 1
- Youliang Yuan 1
- Cong Zeng 1
- Zenan Zhai 1
- Zhenxuan Zhang 1