TAC-CoT: Tool-Empowered Implicit Chain-of-Thought via Interleaving Explicit Tokens

Juseon Do, Sangmin Bae, Jeesu Jung, Hwanjun Song


Abstract
LLM-based agentic systems are increasingly combined with CoT reasoning to solve tasks that require accurate reasoning, external knowledge, and multi-step deliberation. Yet, explicit CoT incurs substantial generation overhead, while implicit CoT, which replaces textual rationales with compact continuous tokens, does not naturally support the explicit communication interface required for agentic tool-use. We propose TAC-CoT, a tool-empowered adaptive implicit CoT framework that replaces explicit reasoning traces with compact latent reasoning segments while retaining textual tokens only for tool calls, observations, and final answers. This interleaved design enables agentic tool-use without verbalizing every intermediate reasoning step. Experiments on agentic math and QA benchmarks show that TAC-CoT improves accuracy by up to 8.8 points while reducing model forward passes by up to 6.8×. Furthermore, analyses show that TAC-CoT improves tool-use quality in both single- and multi-tool settings.
Anthology ID:
2026.emnlp-main.1436
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
32803–32822
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1436/
DOI:
Bibkey:
Cite (ACL):
Juseon Do, Sangmin Bae, Jeesu Jung, and Hwanjun Song. 2026. TAC-CoT: Tool-Empowered Implicit Chain-of-Thought via Interleaving Explicit Tokens. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 32803–32822, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TAC-CoT: Tool-Empowered Implicit Chain-of-Thought via Interleaving Explicit Tokens (Do et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1436.pdf