Rasika Muralidharan
Author directory2026
XChoice: Explainable Evaluation of AI–Human Alignment in LLM-based Constrained Choice Decision Making
Weihong Qi | Fan Huang | Rasika Muralidharan | Jisun An | Haewoon Kwak
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Weihong Qi | Fan Huang | Rasika Muralidharan | Jisun An | Haewoon Kwak
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
We present XChoice, an explainable framework for evaluating AI-human alignment in constrained decision making. Moving beyond outcome agreement such as accuracy and F1 score, XChoice fits a mechanism-based decision model to human data and LLM-generated decisions, recovering interpretable parameters that capture the relative importance of decision factors, constraint sensitivity, and implied trade-offs. Alignment is assessed by comparing these parameter vectors across models, options, and subgroups. We demonstrate XChoice on Americans’ daily time allocation using the American Time Use Survey (ATUS) as human ground truth, revealing heterogeneous alignment across models and activities and salient misalignment concentrated in subgroups defined by race (Black respondents) and marital status (Spouse: Present). We further validate robustness of XChoice via an invariance analysis and evaluate targeted mitigation with a retrieval-augmented generation (RAG) intervention. Overall, XChoice provides mechanism-based metrics that diagnose misalignment beyond surface outcome matching and make the effects of targeted interventions measurable at the mechanism level. Code and data access instructions are available at https://github.com/WeihongQ/xchoice.
PluRule: A Benchmark for Moderating Pluralistic Communities on Social Media
Zoher Kachwala | Bao Tran Truong | Rasika Muralidharan | Haewoon Kwak | Jisun An | Filippo Menczer
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zoher Kachwala | Bao Tran Truong | Rasika Muralidharan | Haewoon Kwak | Jisun An | Filippo Menczer
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Social media are shifting towards pluralism — community-governed platforms where groups define their own norms. What violates rules in one community may be perfectly acceptable in another. Can AI models help moderate such pluralistic communities? We formalize the task as a multiple-choice problem, mirroring how human moderators operate in the real world: given a comment and its surrounding context, identify which specific rule, if any, is violated. We introduce PluRule, a multimodal, multilingual benchmark for detecting 13,371 rule violations across 1,989 Reddit communities spanning 2,885 rules in 9 languages. Using this benchmark, we show that state-of-the-art vision-language models struggle significantly: even GPT-5.2 with high reasoning performs only slightly better than a trivial baseline. We also find that bigger models and increased context provide marginal gains, and universal rules like civility and self-promotion are easier to detect. Our results show that moderation of pluralistic communities on social media is a fundamental challenge for language models. Our code and benchmark are publicly available.