TraceFork: A System for Inspecting GUI-Agent Trajectory Forks

Yuzhang Zhong, Stephen Xia


Abstract
Autonomous GUI and web agents frequently generate long, multi-step execution traces with rich environmental states, making manual inspection and fault localization challenging. Existing visualization tools typically render isolated single-run trajectories, obscuring fine-grained behavioral discrepancies across parallel runs on the same task. We introduce TRACEFORK, an interactive system designed to align, compare, and inspect paired same-task trajectories produced by AI agents or human demonstrators. TRACEFORK ingests execution traces from standardized benchmarks (e.g., WebArena, VisualWebArena) and custom user logs via an extensible normalization schema. Using a multi-modal dynamic programming alignment engine, the system collapses shared prefixes onto a single trunk, isolates behavioral divergence points into distinct branches, and identifies downstream reconvergence via conservative rejoin cues. Across a library of 1,722 tasks and 1,387 aligned trajectory pairs (33,337 steps), TRACEFORK achieves a median alignment latency of 45.5 ms per pair (p95 320.4 ms). On a manually annotated pilot subset, it achieves an F1 score of 0.910 for divergence localization, offering an open-source, deterministic diagnostic workbench for the agent research community.
Anthology ID:
2026.emnlp-demos.15
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
160–166
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.15/
DOI:
Bibkey:
Cite (ACL):
Yuzhang Zhong and Stephen Xia. 2026. TraceFork: A System for Inspecting GUI-Agent Trajectory Forks. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 160–166, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TraceFork: A System for Inspecting GUI-Agent Trajectory Forks (Zhong & Xia, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.15.pdf