The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks

The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks Nikil Selvam author Sunipa Dev author Daniel Khashabi author Tushar Khot author Kai-Wei Chang author 2023-07 text Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) Anna Rogers editor Jordan Boyd-Graber editor Naoaki Okazaki editor Association for Computational Linguistics Toronto, Canada conference publication selvam-etal-2023-tail 10.18653/v1/2023.acl-short.118 https://aclanthology.org/2023.acl-short.118/ 2023-07 1373 1386