Petru Rebeja


pdf bib
A dual-encoding system for dialect classification
Petru Rebeja | Dan Cristea
Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects

In this paper we present the architecture, processing pipeline and results of the ensemble model developed for Romanian Dialect Identification task. The ensemble model consists of two TF-IDF encoders and a deep learning model aimed together at classifying input samples based on the writing patterns which are specific to each of the two dialects. Although the model performs well on the training set, its performance degrades heavily on the evaluation set. The drop in performance is due to the design decision which makes the model put too much weight on presence/lack of textual marks when determining the sample label.