TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languages

Anirudh Srinivasan, Eunsol Choi


Abstract
We study politeness phenomena in nine typologically diverse languages. Politeness is an important facet of communication and is sometimes argued to be cultural-specific, yet existing computational linguistic study is limited to English. We create TyDiP, a dataset containing three-way politeness annotations for 500 examples in each language, totaling 4.5K examples. We evaluate how well multilingual models can identify politeness levels – they show a fairly robust zero-shot transfer ability, yet fall short of estimated human accuracy significantly. We further study mapping the English politeness strategy lexicon into nine languages via automatic translation and lexicon induction, analyzing whether each strategy’s impact stays consistent across languages. Lastly, we empirically study the complicated relationship between formality and politeness through transfer experiments. We hope our dataset will support various research questions and applications, from evaluating multilingual models to constructing polite multilingual agents.
Anthology ID:
2022.findings-emnlp.420
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5723–5738
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.420
DOI:
10.18653/v1/2022.findings-emnlp.420
Bibkey:
Cite (ACL):
Anirudh Srinivasan and Eunsol Choi. 2022. TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languages. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5723–5738, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languages (Srinivasan & Choi, Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.420.pdf
Video:
 https://aclanthology.org/2022.findings-emnlp.420.mp4