Rohan Surana
Author directory2026
An Empirical Study on Zero-Data Bootstrapping for Conversational Recommender Systems
Rohan Surana | Junda Wu | Zhouhang Xie | Yu Xia | Nathan Kallus | Julian McAuley
Findings of the Association for Computational Linguistics: EMNLP 2026
Rohan Surana | Junda Wu | Zhouhang Xie | Yu Xia | Nathan Kallus | Julian McAuley
Findings of the Association for Computational Linguistics: EMNLP 2026
Conversational Recommender Systems (CRS) typically require domain-specific dialogue data, which is costly, scarce, and often unavailable in new domains. We conduct a systematic empirical study of zero-data CRS bootstrapping: generating synthetic conversational supervision from non-conversational signals—item reviews, metadata, and user-item interactions—without any in-domain dialogue corpus. We compare two information-theoretic selection strategies, Jensen-Shannon diversity and Fisher information, across domain signals, model architectures, datasets, and fine-tuning paradigms. Our results show that domain-grounded synthetic data consistently outperforms zero-shot prompting and naive synthetic baselines; active selection improves data efficiency over random sampling; metadata and collaborative filtering signals each improve selection quality; and, in low-resource settings, synthetic data can outperform scarce real dialogues while further complementing them. These findings establish non-conversational domain signals as a viable path toward building CRS without conversational training data. The code is available at https://anonymous.4open.science/r/zero_data_crs/ .
Evaluating Language Model Pluralism through In-the-wild Crowd Discussions
Gagan Mundada | Rohan Surana | Nandhini Swaminathan | Bodhisattwa Prasad Majumder | Junda Wu | Julian McAuley | Zhouhang Xie
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Gagan Mundada | Rohan Surana | Nandhini Swaminathan | Bodhisattwa Prasad Majumder | Junda Wu | Julian McAuley | Zhouhang Xie
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
When answering subjective questions, an ideal LLM should surface diverse plausible perspectives rather than favoring a single viewpoint, a characteristic known as pluralism. Recent studies show that modern LLMs optimized through preference alignment systematically favor certain positions on subjective queries, making pluralism evaluation increasingly important. However, existing evaluation methods focus dominantly on multiple-choice and question-answering tasks, leaving open-ended generation largely unaddressed.We propose PLURALEVAL, an evaluation framework that assesses LLM pluralism in open-ended generation by comparing outputs against free-form crowd responses. Our approach decomposes ground-truth responses into atomic, non-overlapping claims, then evaluates whether LLMs adequately cover this diverse claim space. We then introduce WildSCOPE, a multi-domain dataset of natural crowd responses, and demonstrate that PLURALEVAL captures novel insights, such as the collapse of pluralism through sycophancy, where LLM systematically degrades in overton pluralism when a user’s belief is revealed. Finally, we discuss the value and actionable insights for preserving and encouraging pluralism from LLM deployers’ side.
2025
Image Difference Captioning via Adversarial Preference Optimization
Zihan Huang | Junda Wu | Rohan Surana | Tong Yu | David Arbour | Ritwik Sinha | Julian McAuley
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Zihan Huang | Junda Wu | Rohan Surana | Tong Yu | David Arbour | Ritwik Sinha | Julian McAuley
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Image Difference Captioning (IDC) aims to generate natural language descriptions that highlight subtle differences between two visually similar images. While recent advances leverage pre-trained vision-language models to align fine-grained visual differences with textual semantics, existing supervised approaches often overfit to dataset-specific language patterns and fail to capture accurate preferences on IDC, which often indicates fine-grained and context-aware distinctions. To address these limitations, we propose an adversarial direct preference optimization (ADPO) framework for IDC, which formulates IDC as a preference optimization problem under the Bradley-Terry-Luce model, directly aligning the captioning policy with pairwise difference preferences via Direct Preference Optimization (DPO). To model more accurate and diverse IDC preferences, we introduce an adversarially trained hard negative retriever that selects counterfactual captions, This results in a minimax optimization problem, which we solve via policy-gradient reinforcement learning, enabling the policy and retriever to improve jointly. Experiments on benchmark IDC datasets show that our approach outperforms existing baselines, especially in generating fine-grained and accurate difference descriptions.