InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions

Bodhisattwa Majumder, Zexue He, Julian McAuley


Abstract
Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information ‘fairly,’ with explanations, rather than blindly eliminating it. This fair balance is often subjective and can be challenging to achieve algorithmically. We explore two interactive setups with a frozen predictive model and show that users able to provide feedback can achieve a better and fairer balance between task performance and bias mitigation. In one setup, users, by interacting with test examples, further decreased bias in the explanations (5-8%) while maintaining the same prediction accuracy. In the other setup, human feedback was able to disentangle associated bias and predictive information from the input leading to superior bias mitigation and improved task performance (4-5%) simultaneously.
Anthology ID:
2023.emnlp-main.589
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9466–9471
Language:
URL:
https://aclanthology.org/2023.emnlp-main.589
DOI:
10.18653/v1/2023.emnlp-main.589
Bibkey:
Cite (ACL):
Bodhisattwa Majumder, Zexue He, and Julian McAuley. 2023. InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 9466–9471, Singapore. Association for Computational Linguistics.
Cite (Informal):
InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions (Majumder et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.589.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.589.mp4