HuggingR4: A Progressive Reasoning Framework for Discovering Optimal Model Companions

Shaoyin Ma, Chenggong Hu, Huiqiong Wang, Li Sun, Mingli Song, Jie Song


Abstract
Building effective LLM agents increasingly requires selecting appropriate AI models as tools from large open repositories (*e.g.*, HuggingFace with >2M models) based on natural language requests. Unlike invoking a fixed set of API tools, repository-scale model selection must handle massive, evolving candidates with incomplete metadata. Existing approaches incorporate full model descriptions into prompts, resulting in prompt bloat, excessive token costs, and limited scalability. To address these issues, we propose **HuggingR4**, the first framework to recast model selection as an iterative reasoning process rather than one-shot retrieval. By integrating **R**easoning, **R**etrieval, **R**efinement, and **R**eflection, HuggingR4 progressively decomposes user intent, retrieves candidates through multi-round deliberation, refines selections via fine-grained analysis, and validates results through reflection. To facilitate rigorous evaluation, we introduce a large-scale benchmark comprising 14,399 user requests across 37 task categories. Experiments demonstrate that HuggingR4 achieves 93.01% workability and 84.25% reasonability—outperforming state-of-the-art baselines by absolute margins of 17.81% and 23.13%, respectively, while reducing token consumption by 6.9×.
Anthology ID:
2026.emnlp-main.2120
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48219–48240
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2120/
DOI:
Bibkey:
Cite (ACL):
Shaoyin Ma, Chenggong Hu, Huiqiong Wang, Li Sun, Mingli Song, and Jie Song. 2026. HuggingR4: A Progressive Reasoning Framework for Discovering Optimal Model Companions. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 48219–48240, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
HuggingR4: A Progressive Reasoning Framework for Discovering Optimal Model Companions (Ma et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2120.pdf