AgentTAC: Mining Temporal Action-Context Error Patterns from Agent Traces

Chenchen Zhao, Muxi Chen, Jianhai Shu, Zhaohua Zhang, Wenyu Jiang, Tianwen Jiang, Hexuan Deng, Sa Zhu, Haolin Yang, Geyuan Zhu, Cheng Yang, Qiuyong Xiao, Jianhuan Zhuo, Jihong Zhang, Qiang Xu


Abstract
Interactive agents increasingly fail on long task processes involving user turns, tool calls, and evolving environment contexts. Existing agent debugging methods provide useful trace-level diagnosis, but generally return explanations for individual failed traces rather than recurring, fine-grained action-context patterns across runs. To offer such corpus-level analyses, we present AgentTAC (Temporal Action-Context), an automated framework for mining erroneous and generalizable temporal sequences of action and context properties from agent traces. AgentTAC first localizes all distinct errors in each involved agent run. Then, it constructs and maintains a dynamic pool of attributes over the involved tasks, actions, and contexts to summarize their intrinsic properties and contextual relationships. Finally, it extracts temporally contiguous attribute patterns anchored at the localized errors. The resulting error patterns describe failures as interpretable sequential combinations of context and actions, such as making decisions under a missing-constraint context or taking an action after an incompatible prior decision. Extensive evaluations of AgentTAC on multiple benchmarks and agents validate its capabilities in error localization and error pattern mining, and provide preliminary evidence for error-pattern-driven test-time repair.
Anthology ID:
2026.emnlp-main.1637
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
37202–37222
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1637/
DOI:
Bibkey:
Cite (ACL):
Chenchen Zhao, Muxi Chen, Jianhai Shu, Zhaohua Zhang, Wenyu Jiang, Tianwen Jiang, Hexuan Deng, Sa Zhu, Haolin Yang, Geyuan Zhu, Cheng Yang, Qiuyong Xiao, Jianhuan Zhuo, Jihong Zhang, and Qiang Xu. 2026. AgentTAC: Mining Temporal Action-Context Error Patterns from Agent Traces. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 37202–37222, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AgentTAC: Mining Temporal Action-Context Error Patterns from Agent Traces (Zhao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1637.pdf