Bich Ngoc Doan
Author directory2026
Small Changes, Big Impact: Demographic Bias in LLM-Based Hiring Through Subtle Sociocultural Markers in Anonymised Resumes
Bryan Chen Zhengyu Tan | Shaun Khoo | Bich Ngoc Doan | Zhengyuan Liu | Nancy F. Chen | Roy Ka-Wei Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Bryan Chen Zhengyu Tan | Shaun Khoo | Bich Ngoc Doan | Zhengyuan Liu | Nancy F. Chen | Roy Ka-Wei Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) are increasingly deployed in resume screening pipelines. Although explicit PII (e.g., names) is commonly redacted, resumes typically retain subtle sociocultural markers (languages, co-curricular activities, volunteering, hobbies) that can act as demographic proxies. We introduce a generalisable stress-test framework for hiring fairness instantiated in the Singapore context: 100 neutral job-aligned resumes are augmented into 4100 variants spanning four ethnicities and two genders, differing only in job-irrelevant markers. We evaluate 18 LLMs in two settings: (i) Direct Comparison (1v1) and (ii) Score Shortlist (Top-Score Rates), each with and without rationale prompting. We find that even without explicit identifiers, models recover demographic attributes with high F1 and exhibit systematic disparities, with models favouring markers associated with Chinese and Caucasian males. Ablations show language markers suffice for inferring ethnicity, while hobbies and activities are utilised for gender. Furthermore, prompting for explanations may paradoxically amplify bias. Our findings suggest that seemingly innocuous markers surviving anonymisation can materially skew automated hiring outcomes.
CultureConverse: A Multilingual Multi-turn Simulation Harness for Culturally Grounded Assistance in East and Southeast Asia
Bryan Chen Zhengyu Tan | Weihua Zheng | Thong T. Doan | Bich Ngoc Doan | Jia Wang Peh | Xiaoyuan Yi | Jing Yao | Xing Xie | Nancy F. Chen | Zhengyuan Liu | JinYeong Bak | Wafi Shamdi | Soo Kai Chie | Liew Yu Siong | Aina Azyyati Binti Mohamad Rezal | Lew Yan Yan Vanessa | Huadan Wu | Dylan Raharja | Nadya Yuki Wangsajaya | Akane Fukushige | Kazushi Kato | Koji Inoue | Tatsuya Kawahara | Jaehyung Seo | Dongjun Kim | Seungyoon Lee | Zi Haur Pang | Rui Yang Tan | Charibeth Ko Cheng | Maria Regina Justina Estuar | Jann Railey Montalan | Pham Minh Duc | Roy Ka-Wei Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Bryan Chen Zhengyu Tan | Weihua Zheng | Thong T. Doan | Bich Ngoc Doan | Jia Wang Peh | Xiaoyuan Yi | Jing Yao | Xing Xie | Nancy F. Chen | Zhengyuan Liu | JinYeong Bak | Wafi Shamdi | Soo Kai Chie | Liew Yu Siong | Aina Azyyati Binti Mohamad Rezal | Lew Yan Yan Vanessa | Huadan Wu | Dylan Raharja | Nadya Yuki Wangsajaya | Akane Fukushige | Kazushi Kato | Koji Inoue | Tatsuya Kawahara | Jaehyung Seo | Dongjun Kim | Seungyoon Lee | Zi Haur Pang | Rui Yang Tan | Charibeth Ko Cheng | Maria Regina Justina Estuar | Jann Railey Montalan | Pham Minh Duc | Roy Ka-Wei Lee
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Current cultural evaluations for large language models (LLMs) often reduce culture to single-turn factual recall via MCQs, failing to capture a common use case: users seeking practical help over multiple turns in culturally grounded scenarios. We introduce CultureConverse, a scalable, multilingual simulation and evaluation harness for culturally grounded assistant dialogue that covers 10 East and Southeast Asian regions, 58 subgroup identities, and 7 domains. Each simulated and evaluated episode produces a scored interaction where the assistant assists the user and infers cultural constraints from partial information. The resulting CultureConverse-DS dataset contains 14,610 benchmark (evaluation) episodes and 274,295 oracle-guided (gold-mode) dialogues. In our benchmark evaluation of 18 models, GPT-5 mini achieves the highest assistance quality. Human annotation experiments suggest that our evaluation framework is a sufficient proxy for human judgment. Performance gains from fine-tuning on 27,860 high-quality CultureConverse-DS samples improve in-domain assistance and transfer out-of-domain to cultural MCQ and safety classification benchmarks. We release the harness, both splits, and judge prompts to support interactive evaluation of cultural competency.
Beyond the Rabbit Hole: Mapping the Relational Harms of QAnon Radicalization
Bich Ngoc Doan | Giuseppe Russo | Gianmarco De Francisci Morales
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Bich Ngoc Doan | Giuseppe Russo | Gianmarco De Francisci Morales
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large-scale computational research on conspiracy theories has focused exclusively on believers’ online behavior, leaving the harm experienced by those closest to them under-examined. This paper bridges this gap by analyzing 12747 stories from r/QAnonCasualties, an online support group for people who have “lost” someone to conspiracy beliefs. We design a computational pipeline to extract fine-grained thematic traits from personal narratives and cluster them into six coherent radicalization personas, which we then link to the emotional toll reported by narrators via LLM-assisted emotion detection and regression modeling. We find that personas are meaningful predictors of specific emotional harms: radicalization perceived as a deliberate ideological choice is associated with anger and disgust, while personas marked by personal and cognitive collapse correspond to fear and sadness. This work provides an empirically grounded computational framework for understanding the relational harms of radicalization, opening new avenues for research into its wider social consequences.
Search
Fix author
Co-authors
- Nancy Chen 2
- Roy Ka-Wei Lee 2
- Zhengyuan Liu 2
- Bryan Chen Zhengyu Tan 2
- JinYeong Bak 1
- Charibeth Ko Cheng 1
- Soo Kai Chie 1
- Gianmarco De Francisci Morales 1
- Thong T. Doan 1
- Pham Minh Duc 1
- Maria Regina Justina Estuar 1
- Akane Fukushige 1
- Koji Inoue 1
- Kazushi Kato 1
- Tatsuya Kawahara 1
- Shaun Khoo 1
- Dongjun Kim 1
- Seungyoon Lee 1
- Jann Railey Montalan 1
- Zi Haur Pang 1
- Jia Wang Peh 1
- Dylan Raharja 1
- Aina Azyyati Binti Mohamad Rezal 1
- Giuseppe Russo 1
- Jaehyung Seo 1
- Wafi Shamdi 1
- Liew Yu Siong 1
- Rui Yang Tan 1
- Lew Yan Yan Vanessa 1
- Nadya Yuki Wangsajaya 1
- Zheng Weihua 1
- Huadan Wu 1
- Xing Xie 1
- Jing Yao 1
- Xiaoyuan Yi 1