Yeseon Hong
Author directory2026
MATE: Diagnosing Empathy Calibration Failures in Multi-Turn Human–LLM Interaction
Yeseon Hong | Junhyuk Choi | Minju Kim | Bugeun Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Yeseon Hong | Junhyuk Choi | Minju Kim | Bugeun Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language models are increasingly used in emotionally consequential interactions. Response-level evaluation, however, struggles to diagnose how empathy fails across turns. We introduce MATE (Multi-turn Assessment of calibraTed Empathy), a framework that evaluates empathy as a multi-turn, perception-centered process. Across two controlled studies (N=82), baseline responses exhibit disclosure-insensitive miscalibration: generic validation and formulaic tone read as hollow across turns. A prompt-level self-critique condition makes these patterns less prominent but coincides with a different failure, agreement-skewed miscalibration, where affirmation becomes insufficiently contingent on disclosure context under high persona alignment (62.5% of fit participants in Study 2). Response-level analysis is consistent with a tone–agreement dissociation, as the condition shifts tone toward naturalness while agreement density also increases (+98% under fit vs. +25% under unfit). These findings reframe empathic behavior as relational calibration—consistency among disclosure depth, persona, and response behavior—rather than maximization. Response behavior itself spans tone, agreement, and contextual specificity, sub-dimensions that can drift independently.
2025
People will agree what I think: Investigating LLM’s False Consensus Effect
Junhyuk Choi | Yeseon Hong | Bugeun Kim
Findings of the Association for Computational Linguistics: NAACL 2025
Junhyuk Choi | Yeseon Hong | Bugeun Kim
Findings of the Association for Computational Linguistics: NAACL 2025
Large Language Models (LLMs) have been recently adopted in interactive systems requiring communication. As the false belief in a model can harm the usability of such systems, LLMs should not have cognitive biases that humans have. Psychologists especially focus on the False Consensus Effect (FCE), a cognitive bias where individuals overestimate the extent to which others share their beliefs or behaviors, because FCE can distract smooth communication by posing false beliefs. However, previous studies have less examined FCE in LLMs thoroughly, which needs more consideration of confounding biases, general situations, and prompt changes. Therefore, in this paper, we conduct two studies to examine the FCE phenomenon in LLMs. In Study 1, we investigate whether LLMs have FCE. In Study 2, we explore how various prompting styles affect the demonstration of FCE. As a result of these studies, we identified that popular LLMs have FCE. Also, the result specifies the conditions when FCE becomes more or less prevalent compared to normal usage.