MASkills: Continual Skills Optimization for Multi-Agent LLM Systems

Huaiyuan Yao, Xiaoou Liu, Charles Fleming, Tianlong Chen, Hua Wei


Abstract
LLM-based multi-agent systems have shown strong performance on complex tasks, yet continual improvement from interaction experience remains challenging. Existing self-reflection methods build experience memories, but memories are mostly hard to invoke, refine, or scale, while agent skills offer a more actionable unit: structured procedural knowledge that specifies when to act, how to act, and which resources or tools to use. We introduce MASkills, a continual learning framework that optimizes multi-agent LLM systems through agent skills. MASkills presents a new agent-optimization pipeline that integrates skill-conditioned credit assignment, hierarchical credit aggregation, and momentum-smoothed optimization, enabling agent skill libraries to evolve through refinement, induction, consolidation, and pruning. Experiments on HotpotQA, LoCoMo, and GAIA demonstrate the effectiveness of MASkills across multiple agentic tasks.
Anthology ID:
2026.findings-emnlp.1453
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
30947–30957
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1453/
DOI:
Bibkey:
Cite (ACL):
Huaiyuan Yao, Xiaoou Liu, Charles Fleming, Tianlong Chen, and Hua Wei. 2026. MASkills: Continual Skills Optimization for Multi-Agent LLM Systems. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 30947–30957, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MASkills: Continual Skills Optimization for Multi-Agent LLM Systems (Yao et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1453.pdf