Text Style Transfer for Bias Mitigation using Masked Language Modeling

Ewoenam Kwaku Tokpo, Toon Calders


Abstract
It is well known that textual data on the internet and other digital platforms contain significant levels of bias and stereotypes. Various research findings have concluded that biased texts have significant effects on target demographic groups. For instance, masculine-worded job advertisements tend to be less appealing to female applicants. In this paper, we present a text-style transfer model that can be trained on non-parallel data and be used to automatically mitigate bias in textual data. Our style transfer model improves on the limitations of many existing text style transfer techniques such as the loss of content information. Our model solves such issues by combining latent content encoding with explicit keyword replacement. We will show that this technique produces better content preservation whilst maintaining good style transfer accuracy.
Anthology ID:
2022.naacl-srw.21
Volume:
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Student Research Workshop
Month:
July
Year:
2022
Address:
Hybrid: Seattle, Washington + Online
Editors:
Daphne Ippolito, Liunian Harold Li, Maria Leonor Pacheco, Danqi Chen, Nianwen Xue
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
163–171
Language:
URL:
https://aclanthology.org/2022.naacl-srw.21
DOI:
10.18653/v1/2022.naacl-srw.21
Bibkey:
Cite (ACL):
Ewoenam Kwaku Tokpo and Toon Calders. 2022. Text Style Transfer for Bias Mitigation using Masked Language Modeling. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Student Research Workshop, pages 163–171, Hybrid: Seattle, Washington + Online. Association for Computational Linguistics.
Cite (Informal):
Text Style Transfer for Bias Mitigation using Masked Language Modeling (Tokpo & Calders, NAACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.naacl-srw.21.pdf
Video:
 https://aclanthology.org/2022.naacl-srw.21.mp4