Comparative Analysis of Anomaly Detection Algorithms in Text Data

Yizhou Xu, Kata Gábor, Jérôme Milleret, Frédérique Segond


Abstract
Text anomaly detection (TAD) is a crucial task that aims to identify texts that deviate significantly from the norm within a corpus. Despite its importance in various domains, TAD remains relatively underexplored in natural language processing. This article presents a systematic evaluation of 22 TAD algorithms on 17 corpora using multiple text representations, including monolingual and multilingual SBERT. The performance of the algorithms is compared based on three criteria: degree of supervision, theoretical basis, and architecture used. The results demonstrate that semi-supervised methods utilizing weak labels outperform both unsupervised methods and semi-supervised methods using only negative samples for training. Additionally, we explore the application of TAD techniques in hate speech detection. The results provide valuable insights for future TAD research and guide the selection of suitable algorithms for detecting text anomalies in different contexts.
Anthology ID:
2023.ranlp-1.131
Volume:
Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing
Month:
September
Year:
2023
Address:
Varna, Bulgaria
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
1234–1245
Language:
URL:
https://aclanthology.org/2023.ranlp-1.131
DOI:
Bibkey:
Cite (ACL):
Yizhou Xu, Kata Gábor, Jérôme Milleret, and Frédérique Segond. 2023. Comparative Analysis of Anomaly Detection Algorithms in Text Data. In Proceedings of the 14th International Conference on Recent Advances in Natural Language Processing, pages 1234–1245, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Comparative Analysis of Anomaly Detection Algorithms in Text Data (Xu et al., RANLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.ranlp-1.131.pdf