SkillLadder: Multi-User Skill Evolution with Compliance-Oriented Synchronization and Quality-Gated Synthesis

Nan Chen, Yi Wang, Bin Benjamin Zhu, Haoyi Xiong


Abstract
LLM agents accumulate valuable procedural knowledge during task execution, but these traces are session-bound, model-specific, and often entangled with sensitive content, making them unsafe to pool directly across users. Prior approaches to skill discovery often sacrifice cross-user generalization, iterative quality, or compliance-oriented sharing. We propose SkillLadder, a multi-user framework that distills local execution traces into a shared skill library without funneling raw data to a central server. The system evolves user-contributed traces into a multi-level hierarchy (L0–L3) using five quality gates that prevent regression below the strongest parent skill under a judge-defined score. To ensure safe sharing, SkillLadder distributes only level-≥1 skills that have undergone entity scrubbing and lineage sanitization. On 𝜏2-bench, where each isolated task execution simulates one contributing user—a deliberately conservative proxy for many small local contributors, not a model of longitudinal human users—evolved skills improve a fixed Claude Sonnet 4.6 agent in three of four domains and generalize to simulated users running different agent models. Compliance audits verify that entity retention reaches zero by L3 and source-attribution accuracy is roughly halved, substantially reducing measured sharing risks.
Anthology ID:
2026.findings-emnlp.218
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
4553–4573
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.218/
DOI:
Bibkey:
Cite (ACL):
Nan Chen, Yi Wang, Bin Benjamin Zhu, and Haoyi Xiong. 2026. SkillLadder: Multi-User Skill Evolution with Compliance-Oriented Synchronization and Quality-Gated Synthesis. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 4553–4573, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SkillLadder: Multi-User Skill Evolution with Compliance-Oriented Synchronization and Quality-Gated Synthesis (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.218.pdf