GEAR: Training-Free Rule Distillation for Advanced and Efficient Tool-Augmented Reasoning

Bhiman Kumar Baghel, Fanyou Wu, Suraj Maharjan, Peiran Yao, Srinivasan H. Sengamedu


Abstract
Improving tool use in large reasoning models (LRMs) typically demands expensive test-time compute, training resources unavailable to API-only practitioners, or expensive iterative rollouts with execution feedback required by training-free context-engineering methods, all incompatible with resource-constrained deployment. We introduce **GEAR**, a training-free framework that extracts compositional rules from tool-use failures via single-pass meta-reasoning and distills them into inference prompts. We hypothesize that combining explicit rules with examples outperforms either alone. Across 78 API domains, **GEAR**+2-shot outperforms 3-shot by 24.9% on Qwen3-30B, validating our complementarity hypothesis. On Qwen3-4B, **GEAR** exceeds LoRA SFT by 24.3% and RAG-3-shot by 38.5%, while **GEAR**+2-shot beats the state-of-the-art context-engineering method ACE by 38.8% at 4.1× lower cost. Remarkably, Qwen3-30B with **GEAR**+2-shot nearly doubles zero-shot accuracy while remaining under 1 s latency, demonstrating rollout-free adaptation for resource-constrained deployment.
Anthology ID:
2026.aacl-long.214
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4781–4820
Language:
URL:
https://aclanthology.org/2026.aacl-long.214/
DOI:
Bibkey:
Cite (ACL):
Bhiman Kumar Baghel, Fanyou Wu, Suraj Maharjan, Peiran Yao, and Srinivasan H. Sengamedu. 2026. GEAR: Training-Free Rule Distillation for Advanced and Efficient Tool-Augmented Reasoning. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4781–4820, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
GEAR: Training-Free Rule Distillation for Advanced and Efficient Tool-Augmented Reasoning (Baghel et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.214.pdf