Decomposing LLM Advice Sycophancy: Content, Style, and Framing Drive Distinct Response Dimensions

Jaya Singh, Verena Kaynig-Fittkau


Abstract
Large language models are widely used for personal advice (relationship conflicts, financial decisions, mental-health support, etc.), but they often align their response with the user’s position rather than offering independent judgment, even when users need pushback rather than validation. Mitigating this, whether through training objectives, system-level guardrails, or evaluation design, requires knowing what triggers it. But what in the user’s message triggers this behavior is unknown. Natural advice-seeking messages vary simultaneously in semantic content (what is disclosed), linguistic style (how it is written), and narrative framing (whose side is told), but existing benchmarks cannot attribute model behavior to any single cue. Without this attribution, mitigations cannot be targeted, for example, suppressing warmth may harm users with genuine distress but might not fix the model’s tendency to endorse whichever side of a conflict speaks. In this work, we isolate which of these cues drive which aspect of sycophantic behavior across 787 advice-seeking scenarios and observe three patterns emerge: emotional warmth is content-driven; stance endorsement is framing-driven: endorsement drops by ∼50% when the same conflict is retold from the opposing perspective; and recommendation directness is style-driven. We also find that hedging reduces rather than increases model endorsement; models do not simply validate vulnerable-sounding users.
Anthology ID:
2026.aacl-long.12
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
255–274
Language:
URL:
https://aclanthology.org/2026.aacl-long.12/
DOI:
Bibkey:
Cite (ACL):
Jaya Singh and Verena Kaynig-Fittkau. 2026. Decomposing LLM Advice Sycophancy: Content, Style, and Framing Drive Distinct Response Dimensions. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 255–274, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Decomposing LLM Advice Sycophancy: Content, Style, and Framing Drive Distinct Response Dimensions (Singh & Kaynig-Fittkau, AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.12.pdf