Yan Li
Author directoryOther people with similar names: Yan Li, Yan Li
Unverified author pages with similar names: Yan Li
2026
An Embarrassingly Simple Data Selection Strategy for Million-Scale Multi-Modal Instruction-Tuning
Mengyao Lyu | Yan Li | Huasong Zhong | Hui Chen | Jungong Han | Guiguang Ding | Zhenheng Yang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mengyao Lyu | Yan Li | Huasong Zhong | Hui Chen | Jungong Han | Guiguang Ding | Zhenheng Yang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent research demonstrates that pretrained large language models (LLMs) require minimal but carefully curated data for instruction-tuning. Building on LLMs, multi-modal models further contend with far larger data volumes, heterogeneous sources, and cross-modal alignment, amplifying both the necessity and the complexity of data selection. However, existing methods rely on deeply extracted embeddings, gradients or narrow quality scores that are time-consuming to compute and limited in expressiveness, frequently failing to surpass a simple random-sampling baseline. To overcome these limitations, we step back from complex embedding spaces and target the fundamental objective of instruction tuning: how and what knowledge should be elicited from the pretrained model and exposed to users. We leverage interaction Styles as a proxy for structural diversity, and decompose data quality into capability-specific Scores, yielding an explicit yet Rich (SSR) profile for each sample. We further cast the selection as submodular coverage maximization over the capability-style grid, providing an approximation guarantee. SSR consistently delivers superior performance across two distinct architecture stacks, LLaVA-1.5 (Vicuna + CLIP) and LLaVA-OneVision (Qwen2 + SigLIP), two large-scale data pools, six data budget settings, and 14 multi-modal benchmarks. To our knowledge, SSR is the first data selection method validated at million-scale, achieving 99.1% of full-data performance using only 30% of a 2.6M pool. Furthermore, the SSR profile models and selected subsets transfer training-free across data pools and model architectures with capability extensibility.