Jie Song
Author directoryOther people with similar names: Jie Song, Jie Song
Unverified author pages with similar names: Jie Song
2026
HuggingR4: A Progressive Reasoning Framework for Discovering Optimal Model Companions
Shaoyin Ma | Chenggong Hu | Huiqiong Wang | Li Sun | Mingli Song | Jie Song
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shaoyin Ma | Chenggong Hu | Huiqiong Wang | Li Sun | Mingli Song | Jie Song
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Building effective LLM agents increasingly requires selecting appropriate AI models as tools from large open repositories (*e.g.*, HuggingFace with >2M models) based on natural language requests. Unlike invoking a fixed set of API tools, repository-scale model selection must handle massive, evolving candidates with incomplete metadata. Existing approaches incorporate full model descriptions into prompts, resulting in prompt bloat, excessive token costs, and limited scalability. To address these issues, we propose **HuggingR4**, the first framework to recast model selection as an iterative reasoning process rather than one-shot retrieval. By integrating **R**easoning, **R**etrieval, **R**efinement, and **R**eflection, HuggingR4 progressively decomposes user intent, retrieves candidates through multi-round deliberation, refines selections via fine-grained analysis, and validates results through reflection. To facilitate rigorous evaluation, we introduce a large-scale benchmark comprising 14,399 user requests across 37 task categories. Experiments demonstrate that HuggingR4 achieves 93.01% workability and 84.25% reasonability—outperforming state-of-the-art baselines by absolute margins of 17.81% and 23.13%, respectively, while reducing token consumption by 6.9×.
Evolutionary Negative Module Pruning for Better LoRA Merging
Anda Cao | Zhuo Gou | Yi Wang | Kaixuan Chen | Yu Wang | Can Wang | Mingli Song | Jie Song
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Anda Cao | Zhuo Gou | Yi Wang | Kaixuan Chen | Yu Wang | Can Wang | Mingli Song | Jie Song
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Merging multiple Low-Rank Adaptation (LoRA) experts into a single backbone is a promising approach for efficient multi-task deployment. While existing methods strive to alleviate interference via weight interpolation or subspace alignment, they rest upon the implicit assumption that all LoRA matrices contribute constructively to the merged model. In this paper, we uncover a critical bottleneck in current merging paradigms: the existence of negative modules—specific LoRA layers that inherently degrade global performance upon merging. We propose Evolutionary Negative Module Pruning (ENMP), a plug-and-play LoRA pruning method to locate and exclude these detrimental modules prior to merging. By leveraging an evolutionary search strategy, ENMP effectively navigates the discrete, non-differentiable landscape of module selection to identify optimal pruning configurations. Extensive evaluations demonstrate that ENMP consistently boosts the performance of existing merging algorithms, achieving a new state-of-the-art across both language and vision domains. Code is available at https://github.com/CaoAnda/ENMP-LoRAMerging.