OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling

Ruiqing Zhao, Rui Liu, Yuan Zuo, Huarong Zhang, Xiao Han, Junjie Wu


Abstract
Automated operations research (OR) modeling requires LLMs to translate natural-language decision problems into correct mathematical programs. Existing methods can improve individual formulations, but they often solve problems in isolation, retaining little reusable experience and repeating similar formulation errors. Prior memory-based approaches store examples, thoughts, or insights as references, while OR modeling requires reusable formulation skills that transfer across problem narratives and guide concrete modeling decisions. We propose **OptiSkill**, a skill-augmented framework that builds a hierarchical and evolving SkillBank for LLM-based OR modeling. SkillBank stores solver-verified experience as reusable skills, with *Global Strategies* for problem-level formulation skeletons and *Step Experiences* for local error-prevention rules. It is further refined through stable batch-level test-time evolution, where candidate skills are incorporated only after validation. Experiments on eight OR modeling benchmarks show that OptiSkill improves formulation accuracy across LLM backbones, outperforms strong agentic baselines, and gains further by expanding SkillBank coverage and reliability. Code and data are available at https://anonymous.4open.science/r/OptiSkill-E16F/.
Anthology ID:
2026.emnlp-main.1316
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
29946–29967
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1316/
DOI:
Bibkey:
Cite (ACL):
Ruiqing Zhao, Rui Liu, Yuan Zuo, Huarong Zhang, Xiao Han, and Junjie Wu. 2026. OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 29946–29967, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
OptiSkill: A Hierarchical and Evolving SkillBank for LLM-Based Optimization Modeling (Zhao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1316.pdf