Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice

Helena Choi, Edric Castel C. Hao, Karl Bautista, Francis Gabriel A. Magleo, Renzo Panti, Danielle Beatrice Ledesma Olalia


Abstract
Large language models (LLMs) are increasingly used for emotional support and relationship advice, where a model’s tendency to preserve a user’s face can inadvertently reinforce harmful interpersonal behaviors. To systematically examine this risk, we developed the Romantic Relationship Advice-Seeking Prompts (RRASP) dataset of 2,400 prompts across five relationship themes and evaluated social sycophancy using the ELEPHANT framework on two consumer-facing models, GPT-5 Mini and Gemini 3 Flash. Contrary to our initial hypothesis, grammatical mood alone did not produce systematic differences in sycophantic behavior, suggesting that what a user implies matters more than how they phrase it. Instead, perspective-driven framing had a stronger influence, with gaps between original and flipped prompts widening in follow-up responses. Consistent increases in framing and moral sycophancy across turns indicate that models become more likely to accept a user’s stated premises and affirm their ethical stance as a dialogue progresses. Notably, Gemini 3 Flash exhibited substantially smaller increases in moral sycophancy than GPT-5 Mini, suggesting it is more resistant to reinforcing ethically problematic positions across turns.
Anthology ID:
2026.luhme-1.21
Volume:
Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Rui Sousa-Silva, Henrique Lopes Cardoso, Maarit Koponen, Antonio Pareja-Lora
Venues:
LUHME | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
272–285
Language:
URL:
https://aclanthology.org/2026.luhme-1.21/
DOI:
Bibkey:
Cite (ACL):
Helena Choi, Edric Castel C. Hao, Karl Bautista, Francis Gabriel A. Magleo, Renzo Panti, and Danielle Beatrice Ledesma Olalia. 2026. Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice. In Proceedings of the 3rd Workshop on Language Understanding in the Human-Machine Era (LUHME 2026), pages 272–285, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Sweet Talkers: How Query Formulation Shapes Sycophancy in Romantic Relationship Advice (Choi et al., LUHME 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.luhme-1.21.pdf