Rabee Al-Qasem

Author directory

2026

This paper presents the first investigation into the performance of the Conformer architecture for hierarchical text classification, specifically applied to predicting two-level Arabic text genres. The proposed system combines multilingual sentence embeddings, target label definition representations, a Conformer projection module, an auxiliary broad-genre classifier, synthetic data augmentation, and seed-based ensembling. Evaluated on the official shared task, the approach achieved a Hierarchical Macro-F1 of 0.4399, demonstrating strong high-level genre classification (Broad Macro-F1 of 0.6288) while highlighting ongoing challenges in distinguishing semantically close specific subcategories (Specific Macro-F1 of 0.2511).
We present our system for Daleel 2026 Task 2 on Arabic Argumentative Discourse Unit (ADU) detection. Our main contribution is a Conformer-based tagging architecture that combines a pretrained AraBERT encoder with a Conformer head to capture both global discourse context and local span-boundary cues. To the best of our knowledge, this is the first application of a Conformer-based architecture to Arabic ADU detection. The system also uses overlapping token windows, class-weighted training, character-level span reconstruction, and lightweight post-processing. On the official hidden test set, our system achieved an overall F1 score of 0.732, substantially outperforming the official baseline of 0.285 and ranking fourth in the closed track.

2025

Search
Co-authors
Venues