Xizhi Wang

Author directory

2026

Failure attribution for multi-agent LLM systems is typically formulated as identifying a single decisive error in a failed execution trace. Yet failed traces often contain multiple interacting errors and admit several plausible intervention points. To examine whether an annotated decisive error is also the most promising point for repair, we introduce TriageBench, comprising LLM-council judgments over 1,184 Who When intervention candidates. The council prioritizes a different step from the original label in 59.3% of traces. We therefore reframe failure attribution as severity-ranked diagnostic triage and instantiate it as TRIAGE, a zero-shot, cost-aware cascade combining LLM-as-judge suspicion scoring, structural impact, and LLM-simulated replay over generated repair patches. Under top-K evaluation, TRIAGE reaches 73.9% top-5 on Who When (vs. 42.4% top-1) and 93.2% top-10 on multi-error TRAIL (vs. 56.8% top-1). A separate evaluation of generated top-3 repair sets finds at least one plausible repair on 98.5% / 99% of 326 traces (human rater / 3-LLM panel) under lenient (good + ok) rating. Our code (https://github.com/jimmywang585/triage-failure-attribution) and TriageBench (https://huggingface.co/datasets/jimmywang585/triage-bench) are publicly available.
Search
Co-authors
    Venues
    Fix author