Ahmed Mustafa Younes
2026
DeformAR: A Visual Analytics Framework for Evaluation of Arabic Named Entity Recognition
Ahmed Mustafa Younes
Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script
Ahmed Mustafa Younes
Proceedings of the 2nd Workshop on NLP for Languages Using Arabic Script
Arabic Named Entity Recognition (ANER) presents challenges due to its linguistic characteristics (Qu et al., 2023). While Transformer models have advanced ANER, evaluation still relies heavily on aggregate metrics like F1 score that obscure the interplay between data characteristics, model behaviour, and error patterns. We present DeformAR, a diagnostic visual analytics framework for evaluating and diagnosing Arabic NER systems through structured, component-level analysis and interpretability. DeformAR integrates quantitative metrics with interactive visualizations to support systematic error analysis, dataset and model debugging. In a case study on ANERCorp, DeformAR identifies annotation mistakes, model calibration issues, and subcomponent interaction effects. To our knowledge, this is the first open-source framework for component-level diagnostic evaluation and interpretability in Arabic NER, available at https://github.com/ay94/DeformAR.