LeadEmpathy: An Expert Annotated German Dataset of Empathy in Written Leadership Communication

Didem Sedefoglu, Allison Claire Lahnala, Jasmin Wagner, Lucie Flek, Sandra Ohly


Abstract
Empathetic leadership communication plays a pivotal role in modern workplaces as it is associated with a wide range of positive individual and organizational outcomes. This paper introduces LeadEmpathy, an innovative expert-annotated German dataset for modeling empathy in written leadership communication. It features a novel theory-based coding scheme to model cognitive and affective empathy in asynchronous communication. The final dataset comprises 770 annotated emails from 385 participants who were allowed to rewrite their emails after receiving recommendations for increasing empathy in an online experiment. Two independent annotators achieved substantial inter-annotator agreement of >= .79 for all categories, indicating that the annotation scheme can be applied to produce high-quality, multidimensional empathy ratings in current and future applications. Beyond outlining the dataset’s development procedures, we present a case study on automatic empathy detection, establishing baseline models for predicting empathy scores in a range of ten possible scores that achieve a Pearson correlation of 0.816 and a mean squared error of 0.883. Our dataset is available at https://github.com/caisa-lab/LEAD-empathy-dataset.
Anthology ID:
2024.lrec-main.894
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
10237–10248
Language:
URL:
https://aclanthology.org/2024.lrec-main.894
DOI:
Bibkey:
Cite (ACL):
Didem Sedefoglu, Allison Claire Lahnala, Jasmin Wagner, Lucie Flek, and Sandra Ohly. 2024. LeadEmpathy: An Expert Annotated German Dataset of Empathy in Written Leadership Communication. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 10237–10248, Torino, Italia. ELRA and ICCL.
Cite (Informal):
LeadEmpathy: An Expert Annotated German Dataset of Empathy in Written Leadership Communication (Sedefoglu et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.894.pdf