Multi-View Structural Interpretability of Agentic Reasoning Traces

Ritika Hooda, Sravanthi Machcha, Jackson MacDonald, Lavanika Srinivasaraghavan, Atharva Nijasure, Rui Wang, Lei Shi, Junda Wu, Tong Yu


Abstract
Agentic language models solve tasks through reasoning, tool calls, observations, and terminal answers, exposing rich process information beyond the final answer. For practitioners, knowing which process patterns lead to success or failure is essential to diagnose agent errors and build better process reward models without relying on final-answer supervision. However, existing analyses often evaluate only final outcomes or, when examining traces, flatten them into homogeneous step sequences, fragmenting each reasoning round into disconnected steps. Our key insight is that an agent’s reasoning, action, and observation within a round are better treated as typed segments of a single underlying process state, rather than independent steps. We propose MULTI-VIEW-RA, a reasoning abstraction that represents each round through two complementary views: accumulated state and within-round change. Using unlabeled clustering and binary outcome labels, we apply MULTI-VIEW-RA to two practical use cases: diagnosing failures by surfacing the process states that separate correct from incorrect trajectories, and providing a transition-level correctness signal that is a candidate source of process supervision. Across Math, HotpotQA, and FEVER with multiple Qwen and Llama models, MULTI-VIEW-RA outperforms step-level explainability baselines in cases with sufficient success rates, with particularly strong gains on longer, tool-rich traces.
Anthology ID:
2026.emnlp-industry.222
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3712–3740
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.222/
DOI:
Bibkey:
Cite (ACL):
Ritika Hooda, Sravanthi Machcha, Jackson MacDonald, Lavanika Srinivasaraghavan, Atharva Nijasure, Rui Wang, Lei Shi, Junda Wu, and Tong Yu. 2026. Multi-View Structural Interpretability of Agentic Reasoning Traces. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 3712–3740, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Multi-View Structural Interpretability of Agentic Reasoning Traces (Hooda et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.222.pdf