RuleChef: Grounding LLM Task Knowledge in Human-Editable Rules

Ádám Kovács, Nadia Verdha, Gabor Recski


Abstract
We present RuleChef, a framework that uses large language models (LLMs) to generate executable rules for NLP tasks such as text classification, Named Entity Recognition (NER), or relation extraction. Rules are generated based on a task description and a set of labeled examples, then they are iteratively improved based both on additional examples and on human feedback over existing rules. RuleChef can also be used to bootstrap rules using the observed input-output pairs from any existing model for a given task. LLMs are used only at learning time, synthesizing rules and iteratively patching them based on failures measured on a held-out split. The result of this process is a fast, deterministic, and inspectable rule system. Preliminary evaluation is performed on both classification and NER tasks. We release RuleChef as open-source software under an Apache 2.0 license.
Anthology ID:
2026.groundlm-1.41
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
513–530
Language:
URL:
https://aclanthology.org/2026.groundlm-1.41/
DOI:
Bibkey:
Cite (ACL):
Ádám Kovács, Nadia Verdha, and Gabor Recski. 2026. RuleChef: Grounding LLM Task Knowledge in Human-Editable Rules. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 513–530, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
RuleChef: Grounding LLM Task Knowledge in Human-Editable Rules (Kovács et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.41.pdf