“Global is Good, Local is Bad?”: Understanding Brand Bias in LLMs

Mahammed Kamruzzaman, Hieu Nguyen, Gene Kim


Abstract
Many recent studies have investigated social biases in LLMs but brand bias has received little attention. This research examines the biases exhibited by LLMs towards different brands, a significant concern given the widespread use of LLMs in affected use cases such as product recommendation and market analysis. Biased models may perpetuate societal inequalities, unfairly favoring established global brands while marginalizing local ones. Using a curated dataset across four brand categories, we probe the behavior of LLMs in this space. We find a consistent pattern of bias in this space—both in terms of disproportionately associating global brands with positive attributes and disproportionately recommending luxury gifts for individuals in high-income countries. We also find LLMs are subject to country-of-origin effects which may boost local brand preference in LLM outputs in specific contexts.
Anthology ID:
2024.emnlp-main.707
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12695–12702
Language:
URL:
https://aclanthology.org/2024.emnlp-main.707
DOI:
Bibkey:
Cite (ACL):
Mahammed Kamruzzaman, Hieu Nguyen, and Gene Kim. 2024. “Global is Good, Local is Bad?”: Understanding Brand Bias in LLMs. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 12695–12702, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
“Global is Good, Local is Bad?”: Understanding Brand Bias in LLMs (Kamruzzaman et al., EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.707.pdf
Data:
 2024.emnlp-main.707.data.zip