M. Mustafa Rafique
Author directory2026
Discover, Then Diversify: Phase-Aware Control of Tree-of-Thought Search
Atkia Mahila | Avinash Maurya | M. Mustafa Rafique | Bogdan Nicolae
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Atkia Mahila | Avinash Maurya | M. Mustafa Rafique | Bogdan Nicolae
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Tree-of-Thought (ToT) reasoning has significantly enhanced the problem-solving capabilities of Language Models by enabling the structured exploration of reasoning trajectories. However, the efficiency of these frameworks is often bottlenecked by search algorithms that struggle to navigate vast reasoning spaces at a reasonable inference cost. In this work, we address the challenge of optimizing LLM performance on mathematical reasoning tasks under limited token budgets. A key limitation of existing search strategies is that they apply the same exploration and selection rule throughout the entire search, which under a finite budget, often leads to token exhaustion with suboptimal or no candidate answers. Effective search instead requires different behavior at different stages. We introduce PACE (Phase-Aware Controller for Exploration), a strategy that adjusts its behavior based on the current state of the search: it prioritizes progress toward a first complete answer when none exists, and broadens exploration toward structurally distinct regions later on. Across GSM8K and Math500, two model scales, and token budgets from 3k to 10k, PACE consistently matches or improves over recent state-of-the-art baselines. On GSM8K with Llama-3.2-3B at a 3k budget, PACE delivers roughly a 56% relative accuracy improvement over the strongest tree-search baseline, and an early-stopping variant achieves comparable accuracy using about two-thirds of the tokens.
2025
Bayelemabaga: Creating Resources for Bambara NLP
Allahsera Auguste Tapo | Kevin Assogba | Christopher M. Homan | M. Mustafa Rafique | Marcos Zampieri
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Allahsera Auguste Tapo | Kevin Assogba | Christopher M. Homan | M. Mustafa Rafique | Marcos Zampieri
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Data curation for under-resource languages enables the development of more accurate and culturally sensitive natural language processing models. However, the scarcity of well-structured multilingual datasets remains a challenge for advancing machine translation in these languages, especially for African languages. This paper focuses on creating high-quality parallel corpora that capture linguistic diversity to address this gap. We introduce Bayelemabaga, the most extensive curated multilingual dataset for machine translation in the Bambara language, the vehicular language of Mali. The dataset consists of 47K Bambara-French parallel sentences curated from 231 data sources, including short stories, formal documents, and religious literature, combining modern, historical, and indigenous languages. We present our data curation process and analyze its impact on neural machine translation by fine-tuning seven commonly used transformer-based language models, i.e., MBART, MT5, M2M-100, NLLB-200, Mistral-7B, Open-Llama-7B, and Meta-Llama3-8B on Bayelemabaga. Our evaluation on four Bambara-French language pair datasets (three existing datasets and the test set of Bayelemabaga) show up to +4.5, +11.4, and +0.27 in gains, respectively, on BLEU, CHRF++, and AfriCOMET evaluation metrics. We also conducted machine and human evaluations of translations from studied models to compare the machine translation quality of encoder-decoder and decoder-only models. Our results indicate that encoder-decoder models remain the best, highlighting the importance of additional datasets to train decoder-only models.