Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems

Hehai Lin, Qi Yang, Chengwei Qin


Abstract
Large Language Model (LLM)-based automatic Multi-Agent Systems (MAS) generation has become a crucial frontier for tackling complex tasks. However, existing methods face a dilemma between model capability and experience retention. Inference-time MAS leverages frozen frontier LLMs but repeats identical searches without learning from past experience. Conversely, Training-time MAS internalizes experience via gradient updates but is constrained by the low capability ceiling of smaller models, and is hard to scale to large frontier LLMs. To bridge this gap, we propose Skill-MAS, a novel third path that decouples experience retention from parametric updates by conceptualizing the high-level orchestration capability as an evolvable Meta-Skill. Skill-MAS refines this architectural knowledge through a closed optimization loop: (1) Multi-Trajectory Rollout samples a behavioral distribution for each task under the current Meta-Skill; and (2) Selective Reflection adaptively selects priority tasks and applies hierarchical contrastive analysis to distill systemic experience into generalizable, strategy-level principles. Extensive experiments across four complex benchmarks and four distinct LLMs demonstrate that Skill-MAS not only achieves remarkable performance gains but also maintains a favorable cost-performance trade-off. Further analysis reveals that the evolved Meta-Skills are highly robust and exhibit strong transferability across unseen tasks and different LLMs.
Anthology ID:
2026.findings-emnlp.1582
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
33685–33718
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1582/
DOI:
Bibkey:
Cite (ACL):
Hehai Lin, Qi Yang, and Chengwei Qin. 2026. Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 33685–33718, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Skill-MAS: Evolving Meta-Skill for Automatic Multi-Agent Systems (Lin et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1582.pdf