ToolWeave: Structured Synthesis of Complex Multi-Turn Tool-Calling Dialogues

Dinesh Khandelwal, Gnana Prakash Punnavajhala, G P Shrivatsa Bhargav, Gaurav Pandey, Sachindra Joshi, Hima Karanam, Dinesh Raghu


Abstract
Multi-turn tool calling is essential for LLMs to function as autonomous agents, yet synthesizing the training data required for these capabilities remains a fundamental challenge. Existing synthetic data generation pipelines often produce unrealistic dialogues for two reasons: they chain tools that are only superficially compatible rather than aligned with meaningful user tasks, and they generate dialogues in one shot, which often introduces arguments that were neither provided by the user nor produced by prior tool calls. These issues also lead to a severe underrepresentation of multi-step tool interactions. We introduce ToolWeave, a structured framework for synthesizing realistic multi-turn tool-calling dialogues. ToolWeave supports realistic multi-step workflows (or tool sequences) by constructing tools with built-in dependencies and filtering candidate workflows based on their alignment with user goals. It reduces parameter hallucinations through a fine-grained planning stage that explicitly tracks parameter provenance. As a result, 44.87% of conversational turns in ToolWeave-generated data are multi-step, and the data contains fewer hallucinations in parameters and tool names. Consequently, LLMs fine-tuned on ToolWeave consistently outperform those fine-tuned on prior datasets across three public benchmarks. Notably, Llama-3.1-70B fine-tuned on ToolWeave achieves 39.75% on BFCL-V3, compared to 23.50% when fine-tuned on SOTA ToolFlow data.
Anthology ID:
2026.emnlp-main.429
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9827–9861
Language:
URL:
https://aclanthology.org/2026.emnlp-main.429/
DOI:
Bibkey:
Cite (ACL):
Dinesh Khandelwal, Gnana Prakash Punnavajhala, G P Shrivatsa Bhargav, Gaurav Pandey, Sachindra Joshi, Hima Karanam, and Dinesh Raghu. 2026. ToolWeave: Structured Synthesis of Complex Multi-Turn Tool-Calling Dialogues. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 9827–9861, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ToolWeave: Structured Synthesis of Complex Multi-Turn Tool-Calling Dialogues (Khandelwal et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.429.pdf