Masum Hasan
Author directory2026
ChakmaNMT: Machine Translation for a Low-Resource and Endangered Language via Transliteration
Aunabil Chakma | Aditya Chakma | Masum Hasan | Soham Khisa | Chumui Tripura | Rifat Shahriyar
Proceedings of the Eleventh Conference on Machine Translation
Aunabil Chakma | Aditya Chakma | Masum Hasan | Soham Khisa | Chumui Tripura | Rifat Shahriyar
Proceedings of the Eleventh Conference on Machine Translation
We present a systematic study of machine translation for Chakma, an endangered and extremely low-resource Indo-Aryan language. We introduce a large Chakma–Bangla machine translation resource comprising 15,021 parallel translation pairs, 42,783 Chakma monolingual sentences, and a trilingual evaluation benchmark. To address data scarcity and the script mismatch between Chakma and Bangla, we develop a character-level transliteration framework that enables transfer from Bangla and multilingual pretrained models. We evaluate from-scratch machine translation systems, fine-tuned pretrained models, and large language models using in-context learning. Our results show that transliteration is crucial for the tested pretrained models and that performance is strongly direction-dependent: in-context learning performs best for Chakma-to-Bangla translation, while Bangla-to-Chakma remains considerably more challenging, with the strongest approach depending on the evaluation metric.
Inverse Turing Bench: Evaluating Language Models as Judges of Human vs. AI Dialogue
William Hager | Ishika Rathi | Masum Hasan | Cameron Robert Jones
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
William Hager | Ishika Rathi | Masum Hasan | Cameron Robert Jones
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
As AI systems integrate into online spaces, differentiating them from humans in conversations is increasingly important. We present INVERSE TURING BENCH, a benchmark that evaluates LLMs and other models on their ability to differentiate humans and AI in multi-turn text. The benchmark provides a collection of paired dialogue transcripts, wherein one dialogue is between two humans and the other is between a human and an AI. The task is to correctly identify which dialogue is human-only vs. human-AI. We evaluated a preliminary set of models against this benchmark, and found that GPTZero, Claude Opus-4.6, and GPT-5.5 achieve the highest accuracy: 89.41%, 77.92%, and 75.94% respectively. Our results suggest that statistical approaches to detection have semantic blind spots, but semantic approaches are susceptible to persona-prompting. Our work speaks to the Inverse Turing Test and motivates human-AI differentiation as a critical capability for AI systems. Our live benchmark can be found at https://huggingface.co/spaces/roc-hci/Inverse-Turing-Bench-Leaderboard
HAL: Inducing Human-likeness in LLMs with Alignment
Masum Hasan | Junjie Zhao | Ehsan Hoque
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Masum Hasan | Junjie Zhao | Ehsan Hoque
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Aligning language models to qualitative behavioral traits, such as human-likeness, remains difficult because they are hard to define, measure, and optimize. As a result, improvements in human-like behavior are largely driven by scale or broad supervised training, rather than targeted alignment. We introduce Human Aligning LLMs (HAL), a framework for aligning language models to conversational human-likeness using an interpretable, data-driven reward. HAL derives explicit conversational traits from contrastive dialogue data, combines them into a compact scalar score, and uses this score as a transparent reward signal for alignment with standard preference optimization methods. Using this approach, we align models of varying sizes without affecting their overall performance. In large-scale Chatbot Arena-style human evaluations, a model aligned with HAL is more frequently perceived as human-like in conversation. Because HAL operates over explicit, interpretable traits, it enables inspection of alignment behavior and diagnosis of unintended effects. More broadly, HAL demonstrates how soft, qualitative properties of language–previously outside the scope for alignment–can be made measurable and aligned in an interpretable and explainable way.
2023
LowResource at BLP-2023 Task 2: Leveraging BanglaBert for Low Resource Sentiment Analysis of Bangla Language
Aunabil Chakma | Masum Hasan
Proceedings of the First Workshop on Bangla Language Processing (BLP-2023)
Aunabil Chakma | Masum Hasan
Proceedings of the First Workshop on Bangla Language Processing (BLP-2023)
This paper describes the system of the LowResource Team for Task 2 of BLP-2023, which involves conducting sentiment analysis on a dataset composed of public posts and comments from diverse social media platforms. Our primary aim was to utilize BanglaBert, a BERT model pre-trained on a large Bangla corpus, using various strategies including fine-tuning, dropping random tokens, and using several external datasets. Our final model is an ensemble of the three best BanglaBert variations. Our system achieved overall 3rd in the Test Set among 30 participating teams with a score of 0.718. Additionally, we discuss the promising systems that didn’t perform well namely task-adaptive pertaining and paraphrasing using BanglaT5. Our training codes are publicly available at https://github.com/Aunabil4602/bnlp-workshop-task2-2023
2021
CoDesc: A Large Code–Description Parallel Dataset
Masum Hasan | Tanveer Muttaqueen | Abdullah Al Ishtiaq | Kazi Sajeed Mehrab | Md. Mahim Anjum Haque | Tahmid Hasan | Wasi Ahmad | Anindya Iqbal | Rifat Shahriyar
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Masum Hasan | Tanveer Muttaqueen | Abdullah Al Ishtiaq | Kazi Sajeed Mehrab | Md. Mahim Anjum Haque | Tahmid Hasan | Wasi Ahmad | Anindya Iqbal | Rifat Shahriyar
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Hitting your MARQ: Multimodal ARgument Quality Assessment in Long Debate Video
Md Kamrul Hasan | James Spann | Masum Hasan | Md Saiful Islam | Kurtis Haut | Rada Mihalcea | Ehsan Hoque
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Md Kamrul Hasan | James Spann | Masum Hasan | Md Saiful Islam | Kurtis Haut | Rada Mihalcea | Ehsan Hoque
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
The combination of gestures, intonations, and textual content plays a key role in argument delivery. However, the current literature mostly considers textual content while assessing the quality of an argument, and it is limited to datasets containing short sequences (18-48 words). In this paper, we study argument quality assessment in a multimodal context, and experiment on DBATES, a publicly available dataset of long debate videos. First, we propose a set of interpretable debate centric features such as clarity, content variation, body movement cues, and pauses, inspired by theories of argumentation quality. Second, we design the Multimodal ARgument Quality assessor (MARQ) – a hierarchical neural network model that summarizes the multimodal signals on long sequences and enriches the multimodal embedding with debate centric features. Our proposed MARQ model achieves an accuracy of 81.91% on the argument quality prediction task and outperforms established baseline models with an error rate reduction of 22.7%. Through ablation studies, we demonstrate the importance of multimodal cues in modeling argument quality.
2020
Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation
Tahmid Hasan | Abhik Bhattacharjee | Kazi Samin | Masum Hasan | Madhusudan Basak | M. Sohel Rahman | Rifat Shahriyar
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Tahmid Hasan | Abhik Bhattacharjee | Kazi Samin | Masum Hasan | Madhusudan Basak | M. Sohel Rahman | Rifat Shahriyar
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Despite being the seventh most widely spoken language in the world, Bengali has received much less attention in machine translation literature due to being low in resources. Most publicly available parallel corpora for Bengali are not large enough; and have rather poor quality, mostly because of incorrect sentence alignments resulting from erroneous sentence segmentation, and also because of a high volume of noise present in them. In this work, we build a customized sentence segmenter for Bengali and propose two novel methods for parallel corpus creation on low-resource setups: aligner ensembling and batch filtering. With the segmenter and the two methods combined, we compile a high-quality Bengali-English parallel corpus comprising of 2.75 million sentence pairs, more than 2 million of which were not available before. Training on neural models, we achieve an improvement of more than 9 BLEU score over previous approaches to Bengali-English machine translation. We also evaluate on a new test set of 1000 pairs made with extensive quality control. We release the segmenter, parallel corpus, and the evaluation set, thus elevating Bengali from its low-resource status. To the best of our knowledge, this is the first ever large scale study on Bengali-English machine translation. We believe our study will pave the way for future research on Bengali-English machine translation as well as other low-resource languages. Our data and code are available at https://github.com/csebuetnlp/banglanmt.
Search
Fix author
Co-authors
- Rifat Shahriyar 3
- Aunabil Chakma 2
- Tahmid Hasan 2
- Ehsan Hoque 2
- Wasi Ahmad 1
- Madhusudan Basak 1
- Abhik Bhattacharjee 1
- Aditya Chakma 1
- William Hager 1
- Md. Mahim Anjum Haque 1
- Md Kamrul Hasan 1
- Kurtis Haut 1
- Anindya Iqbal 1
- Abdullah Al Ishtiaq 1
- Md. Saiful Islam 1
- Cameron Robert Jones 1
- Soham Khisa 1
- Kazi Sajeed Mehrab 1
- Rada Mihalcea 1
- Tanveer Muttaqueen 1
- M. Sohel Rahman 1
- Ishika Rathi 1
- Kazi Samin 1
- James Spann 1
- Chumui Tripura 1
- Junjie Zhao 1