This paper presents the first investigation into the performance of the Conformer architecture for hierarchical text classification, specifically applied to predicting two-level Arabic text genres. The proposed system combines multilingual sentence embeddings, target label definition representations, a Conformer projection module, an auxiliary broad-genre classifier, synthetic data augmentation, and seed-based ensembling. Evaluated on the official shared task, the approach achieved a Hierarchical Macro-F1 of 0.4399, demonstrating strong high-level genre classification (Broad Macro-F1 of 0.6288) while highlighting ongoing challenges in distinguishing semantically close specific subcategories (Specific Macro-F1 of 0.2511).
We present our system for Daleel 2026 Task 2 on Arabic Argumentative Discourse Unit (ADU) detection. Our main contribution is a Conformer-based tagging architecture that combines a pretrained AraBERT encoder with a Conformer head to capture both global discourse context and local span-boundary cues. To the best of our knowledge, this is the first application of a Conformer-based architecture to Arabic ADU detection. The system also uses overlapping token windows, class-weighted training, character-level span reconstruction, and lightweight post-processing. On the official hidden test set, our system achieved an overall F1 score of 0.732, substantially outperforming the official baseline of 0.285 and ranking fourth in the closed track.
Use this form to create a GitHub issue describing the correction. You will need a GitHub account.
A staff member will review the issue; see how author pages work.
⚠️ Mobile Users: Submitting this form to create a new issue will only work with github.com, not the GitHub Mobile app.
What would you like to do?
Verify author
Submitted a paper through OpenReview in 2025 or later?
You probably don't need this form: add your ORCID link to your OpenReview profile,
and your page will be verified automatically within a few weeks.