Ilaria Melis

Author directory

2026

The growing use of Large Language Models (LLMs) in healthcare and emotionally sensitive spaces raises critical concerns about safety, ethical alignment, and the risk of unintentional emotional harm. Our approach provides a structured, multilingual, and culturally grounded analysis of persuasive and anxiety-inducing language generated by LLMs during interactions with users in conditions of psychological or physical vulnerability. To study our model, we introduce the first Multilingual Emotional Escalation Framework, a two-phase interaction framework designed to simulate emotional escalation and to assess whether the model’s responses amplify anxiety, reinforce false beliefs, or exhibit excessive diagnostic intrusiveness across six languages, using different LLM families within a unified experimental pipeline. Finally, we propose quantitative and qualitative metrics to capture anxiety amplification, catastrophic linguistic patterns, and diagnostic safety. The results highlight significant crosslingual and cross-cultural disparities, underlining the importance of emotional alignment between models and users.