EmoDistill: Offline Emotion Skill Distillation for Language Model Agents in Adversarial Negotiation

Yunbo Long, Haolang Zhao, Lukas Beckenbauer, Liming Xu, Alexandra Brintrup


Abstract
Post-trained LLMs are often optimized to produce helpful, polite, and accommodating responses. In adversarial negotiation, however, such behavior can become a vulnerability: emotionally framed language may influence an agent’s bargaining decisions in ways that conflict with its user’s objectives. We therefore introduce EmoDistill, an offline framework for distilling emotional negotiation skills from LLM–LLM interactions into smaller language-model agents. Here, an emotional negotiation skill is a state-conditioned behavior that determines which explicit emotion to invoke in a bargaining state and how to realize that emotion as an effective negotiation utterance. EmoDistill learns these two components separately: an Implicit Q-Learning (IQL) selector learns which emotion to express in each bargaining state, while a LoRA-adapted 7B policy learns the emotion-conditioned expression through Supervised Fine-Tuning (SFT) and Judge Policy Optimization (JPO). Across four emotion-sensitive negotiation domains, the full EmoDistill policy achieves competitive Utility and improves over vanilla and IQL-only baselines in most settings. Emotion-free ablations show that removing the explicit emotion channel substantially reduces overall negotiation utility, while transfer experiments reveal partial, domain-dependent transfer and robustness to unseen LLM counterparties. The code is available at https://github.com/Yunbo-max/EmoDistill.
Anthology ID:
2026.findings-emnlp.1078
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
22804–22837
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1078/
DOI:
10.18653/2026.findings-emnlp.1078
Bibkey:
Cite (ACL):
Yunbo Long, Haolang Zhao, Lukas Beckenbauer, Liming Xu, and Alexandra Brintrup. 2026. EmoDistill: Offline Emotion Skill Distillation for Language Model Agents in Adversarial Negotiation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 22804–22837, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
EmoDistill: Offline Emotion Skill Distillation for Language Model Agents in Adversarial Negotiation (Long et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1078.pdf