GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration

Yeahia Sarker, Md Rahmat Ullah, Musa Molla, Shafiq Joty


Abstract
Agentic LLM frameworks that rely on prompted orchestration, where the model itself determines workflow transitions, often suffer from hallucinated routing, infinite loops, and non-reproducible execution. We introduce GraphBit, an engine-orchestrated framework that defines workflows explicitly and deterministically as a directed acyclic graph (DAG). Unlike prompted orchestration, agents in GraphBit operate as typed functions, while a Rust-based engine governs routing, state transitions, and tool invocation, ensuring reproducibility and auditability. The engine supports parallel branch execution, conditional control flow over structured state predicates, and configurable error recovery. A three-tier memory architecture (ephemeral scratch space, structured state, and external connectors) isolates context across stages, preventing cascading context bloat that degrades reasoning in long-running pipelines. Across GAIA benchmark tasks spanning zero-tool, document-augmented, and web-enabled workflows, GraphBit shows excellent performance achieving the highest accuracy, zero orchestration errors, the lowest latency, and the highest throughput. Ablation studies demonstrate that each memory tier contributes measurably to performance with similar configuration due to architectural changes, with deterministic execution providing the greatest gains on tool-intensive tasks representative of real-world deployments.

Code and data: https://github.com/InfinitiBit/graphbit
Anthology ID:
2026.emnlp-industry.203
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3412–3425
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.203/
DOI:
Bibkey:
Cite (ACL):
Yeahia Sarker, Md Rahmat Ullah, Musa Molla, and Shafiq Joty. 2026. GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 3412–3425, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GraphBit: A Graph-based Agentic Framework for Non-Linear Agent Orchestration (Sarker et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.203.pdf