As Large Language Models (LLMs) continue to improve on complex tasks, evaluation has shifted from simple factoid retrieval to multi-hop reasoning. While existing studies analyze structural aspects of sequential steps, analysis from diverse multiple perspectives remains limited. This paper introduces a framework for the automated, multi-perspective analysis of QA datasets and its application to LLM answer diagnosis. An Analyst LLM is utilized to (1) generate explicit sequential steps from question-context-answer triples in a zero-shot setting, (2) synthesize a taxonomy of reasoning features from educational, logical, and professional perspectives. The resulting annotations are then used to (3) analyze associations between these features and Target LLM failures via decision tree training. Applied to the FRAMES, Multihop-RAG, and MuSiQue datasets, our decision tree analysis identifies dataset-specific bottlenecks such as Implicit Math in FRAMES, Conditioned Filtering in Multihop-RAG, and Temporal Order Logic Paradox in MuSiQue, overlooked by structural analysis.