Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory

Divyesh Bommana, Mohammad Saim, Tianyu Jiang


Abstract
Emotion recognition benchmarks predict one emotion per text, missing many real-world scenarios where two people arrive at opposing emotions from a single shared trigger. For example, a child kicks her seat in excitement while the passenger ahead feels mounting irritation. We introduce Chiaro, a 1,000 human-annotated sentence benchmark for contrastive emotion inference grounded in appraisal theory. Each scene describes one causal trigger eliciting a positive emotion in one person and a negative emotion in the other, drawn from a ten-class taxonomy. We benchmark seven frontier LLMs and four off-the-shelf emotion classifiers, where the strongest LLM reaches 67.3 macro-F1, well below human agreement, while existing emotion classifiers score near chance. Beyond evaluation, Chiaro also serves as a training signal: combined with an existing emotion corpus, the resulting downstream classifier improves on Chiaro itself and on six of ten external emotion benchmarks, positioning Chiaro as a complementary signal for emotion recognition.
Anthology ID:
2026.emnlp-main.1031
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23684–23701
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1031/
DOI:
Bibkey:
Cite (ACL):
Divyesh Bommana, Mohammad Saim, and Tianyu Jiang. 2026. Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 23684–23701, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Chiaroscuro for Emotions: A Contrastive Emotion Benchmark Grounded in Appraisal Theory (Bommana et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1031.pdf