SkillCombiner: Optimizing Agent Skills via Edit Combination Search

Seungbeom Park, Jaewon Chu, Hyunwoo J. Kim


Abstract
Large language model agents are often guided by reusable natural-language skills that provide task-specific instructions. Existing work automatically refines these skills by using LLMs to propose and repeatedly incorporate textual edits from agent feedback. We find that the resulting performance depends substantially on which proposed edits are combined, and adding an edit can even degrade the skill. We therefore introduce SkillCombiner, which generates candidate edits and explicitly searches over their combinations. Across various settings, SkillCombiner matches or exceeds a strong baseline in mean performance while reducing optimizer cost by 75.2% and total optimization-stage cost by 21.5% on average. These results show that edit combination is an important optimization target in agent skill refinement.
Anthology ID:
2026.realm-1.81
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1188–1197
Language:
URL:
https://aclanthology.org/2026.realm-1.81/
DOI:
Bibkey:
Cite (ACL):
Seungbeom Park, Jaewon Chu, and Hyunwoo J. Kim. 2026. SkillCombiner: Optimizing Agent Skills via Edit Combination Search. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 1188–1197, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SkillCombiner: Optimizing Agent Skills via Edit Combination Search (Park et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.81.pdf