Aditya Vashistha
Author directory2026
Toward Cultural Alignment: Human-Centered Evaluation of Multimodal AI Stories Across Five African Communities
Millicent Ochieng | Felermino D. M. A. Ali | Elizabeth A. Ankrah | Najeeb Gambo Abdulhamid | Migisha Boyd | Stephanie Nyairo | Mercy Muchai | Samuel Chege Maina | Aditya Vashistha | Anja Thieme | Jacki O’Neill
Findings of the Association for Computational Linguistics: EMNLP 2026
Millicent Ochieng | Felermino D. M. A. Ali | Elizabeth A. Ankrah | Najeeb Gambo Abdulhamid | Migisha Boyd | Stephanie Nyairo | Mercy Muchai | Samuel Chege Maina | Aditya Vashistha | Anja Thieme | Jacki O’Neill
Findings of the Association for Computational Linguistics: EMNLP 2026
In this paper, we examine how well AI-generated multimodal stories align with the lived practices, relationships, language, values, and visual expectations of the communities they represent. We conduct a community-grounded mixed-methods evaluation with 19 culture representatives across five African communities, combining quantitative annotations with qualitative focus group discussions. We find that cultural alignment depends not simply on recognizable cultural markers, but on how those markers fit social, linguistic, procedural, and visual context. From these evaluations, we develop a taxonomy of cultural alignment comprising five broader cultural marker categories and eight recurring mechanisms of misalignment. We additionally evaluate five multimodal LLM judges to examine whether automated evaluation can approximate community-grounded judgments at scale. Judge reliability and score calibration vary substantially across communities, with no single judge performing consistently across all five settings. These findings motivate community-calibrated evaluation pipelines in which automated judges are validated against community judgments to determine where they can be trusted and where human review remains necessary.
2022
“#DisabledOnIndianTwitter” : A Dataset towards Understanding the Expression of People with Disabilities on Indian Twitter
Ishani Mondal | Sukhnidh Kaur | Kalika Bali | Aditya Vashistha | Manohar Swaminathan
Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022
Ishani Mondal | Sukhnidh Kaur | Kalika Bali | Aditya Vashistha | Manohar Swaminathan
Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022
Twitter serves as a powerful tool for self-expression among the disabled people. To understand how disabled people in India use Twitter, we introduce a manually annotated corpus #DisabledOnIndianTwitter comprising of 2,384 tweets posted by 27 female and 15 male users. These users practice diverse professions and engage in varied online discourses on disability in India. To examine patterns in their Twitter use, we propose a novel hierarchical annotation taxonomy to classify the tweets into various themes including discrimination, advocacy, and self-identification. Using these annotations, we benchmark the corpus leveraging state-of-the-art classifiers. Finally through a mixed-methods analysis on our annotated corpus, we reveal stark differences in self-expression between male and female disabled users on Indian Twitter.