Using Language Models for assessment of users’ satisfaction with their partner in Persian

Zahra Habibzadeh, Masoud Asadpour


Abstract
Sentiment analysis, the process of gauging user attitudes and emotions through their textual data, including social media posts and other forms of communication, is a valuable tool for informed decision-making. In other words, a statement conveys positivity, negativity, or neutrality, sentiment analysis offers insights into public sentiment regarding a product, individual, event, or other significant topics. This research focuses on the effectiveness of sentiment analysis techniques, using Machine Learning (ML) and Natural Language Processing (NLP) especially pre-trained language models for Persian, in assessing users’ satisfaction with their partner, using data collected from X (formerly Twitter). Our motivation stems from traditional in-person surveys, which periodically analyze societal challenges in Iran. The limitations of these surveys led us to explore Artificial Intelligence (AI) as an alternative solution for addressing contemporary social issues. We collected Persian tweets and utilized data annotation techniques to label them according to our research question, forming the dataset. Our goal also was to provide a benchmark of Persian tweets on this specific topic. To evaluate our dataset, we employed several classification methods to achieve our goal, including classical ML models, Deep Neural Networks, and pre-trained language models for Persian. Following a comprehensive evaluation, our results show that BERTweet-FA (one of the pre-trained language models for Persian) emerged as the best performer among the classifiers for assessing users’ satisfaction. This point indicates the ability of language models to understand conversational Persian text and perform sentiment analysis, even in a low-resource language like Persian.
Anthology ID:
2025.loreslm-1.5
Volume:
Proceedings of the First Workshop on Language Models for Low-Resource Languages
Month:
January
Year:
2025
Address:
Abu Dhabi, United Arab Emirates
Editors:
Hansi Hettiarachchi, Tharindu Ranasinghe, Paul Rayson, Ruslan Mitkov, Mohamed Gaber, Damith Premasiri, Fiona Anting Tan, Lasitha Uyangodage
Venues:
LoResLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
78–88
Language:
URL:
https://aclanthology.org/2025.loreslm-1.5/
DOI:
Bibkey:
Cite (ACL):
Zahra Habibzadeh and Masoud Asadpour. 2025. Using Language Models for assessment of users’ satisfaction with their partner in Persian. In Proceedings of the First Workshop on Language Models for Low-Resource Languages, pages 78–88, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Using Language Models for assessment of users’ satisfaction with their partner in Persian (Habibzadeh & Asadpour, LoResLM 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.loreslm-1.5.pdf
Optionalsupplementarymaterial:
 2025.loreslm-1.5.OptionalSupplementaryMaterial.zip