Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model

Chantal Amrhein, Florian Schottmann, Rico Sennrich, Samuel Läubli


Abstract
Natural language generation models reproduce and often amplify the biases present in their training data. Previous research explored using sequence-to-sequence rewriting models to transform biased model outputs (or original texts) into more gender-fair language by creating pseudo training data through linguistic rules. However, this approach is not practical for languages with more complex morphology than English. We hypothesise that creating training data in the reverse direction, i.e. starting from gender-fair text, is easier for morphologically complex languages and show that it matches the performance of state-of-the-art rewriting models for English. To eliminate the rule-based nature of data creation, we instead propose using machine translation models to create gender-biased text from real gender-fair text via round-trip translation. Our approach allows us to train a rewriting model for German without the need for elaborate handcrafted rules. The outputs of this model increased gender-fairness as shown in a human evaluation study.
Anthology ID:
2023.acl-long.246
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4486–4506
Language:
URL:
https://aclanthology.org/2023.acl-long.246
DOI:
10.18653/v1/2023.acl-long.246
Bibkey:
Cite (ACL):
Chantal Amrhein, Florian Schottmann, Rico Sennrich, and Samuel Läubli. 2023. Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4486–4506, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Exploiting Biased Models to De-bias Text: A Gender-Fair Rewriting Model (Amrhein et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.246.pdf
Video:
 https://aclanthology.org/2023.acl-long.246.mp4