Guanxu Chen

Author directory

2026

As LLMs scale, improving training efficiency relies on effective data utilization. Data selection mitigates this issue by allocating limited data budget to examples that optimally facilitate target behavior. Most existing approaches define target behavior via a set of target examples and score candidate training examples based on estimated influence on the target set. However, such methods treat target examples as equally important, ignoring their relevance to model optimization. Target examples that align closely with the model’s inherent behavior deliver stronger supervisory signals, whereas discrepant examples yield weak local guidance. We propose PRISM, a Preference-aware Influence function based Data Selection Method. It uses model preference to weight examples and build a preference-aware target direction. PRISM evaluates candidate training examples according to influence on this direction, and prioritizes data budget allocation to examples that drive the model to match target behavior. Theoretical analysis shows that preference weighting yields a superior first-order direction for boosting target preference, relative to equal aggregation. Experiments across model architectures and scales show that PRISM improves data selection in both capability improvement and reverse repair. The results validate that accurate characterization of target behavior serves as the core of cost-effective data selection.