TRACE: Traceable Root-cause Analysis with Calibrated Evidence-grounded agents

Aniket Joshi, Cyrus Andre DSouza, Sejal Jain, Manjunath Channappagoudar


Abstract
Root Cause Analysis (RCA) for defects in large e-commerce enterprises is manual and slow: a single defect spanning thousands of microservices and SOPs takes experts one to two weeks to diagnose. Generic agentic RCA frameworks fail on this workload because they stop at proximate causes, cannot verify numeric claims, ignore past reviewer decisions, and return enumerated hypotheses rather than the quantified narratives business teams act on. We present Trace, an end-to-end agentic RCA system that combines supervised hypothesis-driven investigation with recursive why-drilling, an evidence-traceable multi-tool suite with stable artifact identifiers, a feedback retrieval and ingestion pipeline, and a two-layer confidence framework combining six mechanistic checks with an LLM judge - including a novel numerical-traceability score. Across several thousand cohorts spanning eight use cases in three metric categories (cost, quality, and inventory), Trace achieves 65.4% expert acceptance; on a 240-cohort head-to-head benchmark it reaches 67.1% vs. 38.8% for a matched ReAct baseline (+28.3pp, p<0.001) with calibrated confidence (AUC 0.819, ECE 0.041).
Anthology ID:
2026.emnlp-industry.135
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2279–2289
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.135/
DOI:
Bibkey:
Cite (ACL):
Aniket Joshi, Cyrus Andre DSouza, Sejal Jain, and Manjunath Channappagoudar. 2026. TRACE: Traceable Root-cause Analysis with Calibrated Evidence-grounded agents. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 2279–2289, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TRACE: Traceable Root-cause Analysis with Calibrated Evidence-grounded agents (Joshi et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.135.pdf