Evaluation of Multilingual LLMs Personalized Text Generation Capabilities Targeting Groups and Social-Media Platforms

Dominik Macko


Abstract
Capabilities of large language models to generate multilingual coherent text have continuously enhanced in recent years, which opens concerns about their potential misuse. Previous research has shown that they can be misused for generation of personalized disinformation in multiple languages. It has also been observed that personalization negatively affects detectability of machine-generated texts; however, this has been studied in the English language only. In this work, we examine this phenomenon across 10 languages, while we focus not only on potential misuse of personalization capabilities, but also on potential benefits they offer. Overall, we cover 1080 combinations of various personalization aspects in the prompts, for which the texts are generated by 16 open-weights models drawn from 5 architecturally distinct families, including multiple size variants per family to assess scale effects (17,280 texts in total). Our results indicate that there are statistically significant differences in personalization quality of the generated texts when targeting demographic groups and when targeting social-media platforms across languages. Personalization towards platforms affects detectability of the generated texts in a higher scale, especially in English, where the personalization quality is the highest.
Anthology ID:
2026.findings-aacl.241
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4741–4760
Language:
URL:
https://aclanthology.org/2026.findings-aacl.241/
DOI:
Bibkey:
Cite (ACL):
Dominik Macko. 2026. Evaluation of Multilingual LLMs Personalized Text Generation Capabilities Targeting Groups and Social-Media Platforms. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 4741–4760, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Evaluation of Multilingual LLMs Personalized Text Generation Capabilities Targeting Groups and Social-Media Platforms (Macko, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.241.pdf