Debiasing by obfuscating with 007-classifiers promotes fairness in multi-community settings

Ingroj Shrestha, Padmini Srinivasan


Abstract
While there has been considerable amount of research on bias mitigation algorithms, two properties: multi-community perspective and fairness to *all* communities have not been given sufficient attention. Focusing on these, we propose an obfuscation based data augmentation debiasing approach. In it we add to the training data *obfuscated* versions of *all* false positive instances irrespective of source community. We test our approach by debiasing toxicity classifiers built using 5 neural models (multi layer perceptron model and masked language models) and 3 datasets in a 4 communities setting. We also explore 4 different obfuscators for debiasing. Results demonstrate the merits of our approach: bias is reduced for almost all of our runs without sacrificing false positive rates or F1 scores for minority or majority communities. In contrast, the 4 state of the art baselines typically make performance sacrifices (often large) while reducing bias. Crucially, we demonstrate that it is possible to debias while maintaining standards for both minority and majority communities.
Anthology ID:
2025.coling-main.42
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
621–636
Language:
URL:
https://aclanthology.org/2025.coling-main.42/
DOI:
Bibkey:
Cite (ACL):
Ingroj Shrestha and Padmini Srinivasan. 2025. Debiasing by obfuscating with 007-classifiers promotes fairness in multi-community settings. In Proceedings of the 31st International Conference on Computational Linguistics, pages 621–636, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Debiasing by obfuscating with 007-classifiers promotes fairness in multi-community settings (Shrestha & Srinivasan, COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.42.pdf