ReVEL: Multi-Turn Reflective LLM-Guided Heuristic Evolution via Structured Performance Feedback

Van Duc Cuong, Nguyen Dinh Tuan Minh, Vu Duc Tam, Tung D. Vu, Son Van Nguyen, Nguyen Thi Hanh, Huynh Thi Thanh Binh


Abstract
Designing effective heuristics for NP-hard combinatorial optimization problems remains challenging and often requires substantial domain expertise. Recent LLM-guided evolutionary methods have shown promise for automated heuristic generation, but most existing approaches refine heuristics independently or through limited pairwise feedback. We propose **ReVEL**: Multi-Turn Reflective LLM-Guided Heuristic Evolution via Structured Performance Feedback, a framework for group-wise multi-turn heuristic refinement. ReVEL organizes heuristics into behavior-aware reflective groups, including similarity-driven groups for localized refinement and diversity-driven groups for exploratory search. Within each group, the LLM performs iterative multi-turn refinement using accumulated performance feedback, enabling related heuristics to be jointly analyzed and progressively improved across evolutionary iterations. Experiments on standard combinatorial optimization benchmarks show that ReVEL generally improves optimization performance over existing LLM-guided evolutionary baselines across multiple settings and LLM backbones. Additional analyses suggest that behavior-aware grouping contributes to more consistent refinement trajectories during iterative heuristic evolution.
Anthology ID:
2026.findings-emnlp.1030
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
21762–21782
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1030/
DOI:
Bibkey:
Cite (ACL):
Van Duc Cuong, Nguyen Dinh Tuan Minh, Vu Duc Tam, Tung D. Vu, Son Van Nguyen, Nguyen Thi Hanh, and Huynh Thi Thanh Binh. 2026. ReVEL: Multi-Turn Reflective LLM-Guided Heuristic Evolution via Structured Performance Feedback. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 21762–21782, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ReVEL: Multi-Turn Reflective LLM-Guided Heuristic Evolution via Structured Performance Feedback (Cuong et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1030.pdf