Comparative Study of Classical NLP and Pretrained Language Models for Tunisian Dialect Processing

Latifa Iben Nasr, Ismail Badache, Lamia Belguith


Abstract
Recent transformer-based language models rely on subword tokenization and contextual embeddings, raising questions about the continued effectiveness of traditional preprocessing techniques such as stemming. This issue remains underexplored for low-resource Arabic dialects, particularly Tunisian Dialect (TD). In this paper, we investigate the impact of light and aggressive stemming on two main Tunisian NLP tasks: sentiment analysis and domain classification. We compare classical machine learning methods with transformer-based Arabic language models, including TunBERT. To support this study, we release an open Tunisian stemming resource containing 7,730 words annotated with both light and aggressive stems. Our experiments provide a comprehensive analysis of TD processing and show that the effectiveness of stemming depends on both the task and the model type.
Anthology ID:
2026.arabicnlp-main.22
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
317–324
Language:
URL:
https://aclanthology.org/2026.arabicnlp-main.22/
DOI:
Bibkey:
Cite (ACL):
Latifa Iben Nasr, Ismail Badache, and Lamia Belguith. 2026. Comparative Study of Classical NLP and Pretrained Language Models for Tunisian Dialect Processing. In Proceedings of The Fourth Arabic Natural Language Processing Conference, pages 317–324, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Comparative Study of Classical NLP and Pretrained Language Models for Tunisian Dialect Processing (Nasr et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-main.22.pdf