A Geometry-Aware Depth Function for Robust Unsupervised Textual Anomaly Detection

Pierre Fihey, Matthieu Labeau, Pavlo Mozharovskyi


Abstract
Textual anomaly detection (AD) aims to identify samples that deviate from the underlying distribution of normal data, without requiring explicit supervision on anomalies. Existing literature has focused almost exclusively on the semi-supervised setting, assuming access to clean training datasets composed solely of normal samples. However, this assumption rarely holds in real-world scenarios, as datasets used to infer the normal distribution are frequently contaminated by anomalies. In this work, we first highlight the sensitivity of conventional anomaly detection methods to contamination, before demonstrating the relevance of data depth functions for robust textual anomaly detection. Building on recent findings regarding the geometry of language model embeddings, further supported by our empirical observations, we introduce the geodesic depth to better capture the structure of contextual embedding spaces. Our results show that the geodesic depth consistently outperforms commonly used anomaly detection methods once contamination exceeds 10% in the training data, with substantially larger improvements observed in the most challenging scenarios.
Anthology ID:
2026.findings-emnlp.1731
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
37011–37030
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1731/
DOI:
Bibkey:
Cite (ACL):
Pierre Fihey, Matthieu Labeau, and Pavlo Mozharovskyi. 2026. A Geometry-Aware Depth Function for Robust Unsupervised Textual Anomaly Detection. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 37011–37030, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Geometry-Aware Depth Function for Robust Unsupervised Textual Anomaly Detection (Fihey et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1731.pdf