Rui Song
Author directoryOther people with similar names: Rui Song, Rui Song, Rui Song
Unverified author pages with similar names: Rui Song
2026
CARE: Privacy-Compliant Agentic Reasoning with Evidence Discordance
Haochen Liu | Weien Li | Rui Song | Zeyu Li | Chun Jason Xue | Xiao-Yang Liu | Sam Nallaperuma-Herzberg | Xue Liu | Ye Yuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Haochen Liu | Weien Li | Rui Song | Zeyu Li | Chun Jason Xue | Xiao-Yang Liu | Sam Nallaperuma-Herzberg | Xue Liu | Ye Yuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Large language model (LLM) systems are increasingly used to support high-stakes decision-making, but they typically perform worse when the available evidence is internally inconsistent. Such a scenario exists in real-world healthcare settings, with patient-reported symptoms contradicting medical signs. To study this problem, we introduce **MIMIC-DOS**, a dataset for short-horizon organ dysfunction worsening prediction in the intensive care unit (ICU) setting. We derive this dataset from the widely recognized MIMIC-IV, a publicly available electronic health record dataset, and construct it exclusively from cases in which discordance between signs and symptoms exists. This setting poses a substantial challenge for existing LLM-based approaches, with single-pass LLMs and agentic pipelines often struggling to reconcile such conflicting signals. To address this problem, we propose **CARE**: a multi-stage privacy-compliant agentic reasoning framework in which a proprietary LLM provides guidance by generating structured categories and transitions without accessing sensitive patient data, while a local LLM uses these categories and transitions to support evidence acquisition and final decision-making. Empirically, under controlled retrospective evaluation on MIMIC-DOS, CARE achieves the best overall performance across key metrics among the evaluated LLMs and agentic workflows, showing that it can more robustly handle conflicting clinical evidence while preserving privacy. Our code is [here](https://github.com/AAAAA-Academia-Attractions/CARE).
QUACK: Questioning, Understanding, and Auditing Communicated Knowledge in Multimodal Social Deduction Agents
Ye Yuan | Rui Song | Weien Li | Zeyu Li | Haochen Liu | Xiangyu Kong | Changjiang Han | Yonghan Yang | Zichen Zhao | Zixuan Dong | Fuyuan Lyu | Bowei He | Haolun Wu | Jikun Kang | Xue Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ye Yuan | Rui Song | Weien Li | Zeyu Li | Haochen Liu | Xiangyu Kong | Changjiang Han | Yonghan Yang | Zichen Zhao | Zixuan Dong | Fuyuan Lyu | Bowei He | Haolun Wu | Jikun Kang | Xue Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Social deduction games have become a popular testbed for probing reasoning, deception, coordination, and belief modeling in Large Language Model (LLM) agents. However, most environments are scored only by game outcomes such as win rates and largely remain to text-only interaction, making it difficult to tell whether an agent’s language is actually grounded in what it perceived and did, or to identify the failure modes underlying its behavior. To address this gap, we introduce QUACK, an open-source environment and evaluation framework for auditing the grounding of agent language in multimodal social reasoning. QUACK evaluates agents at three levels: game outcomes, behavioral trajectories, and utterance-level consistency. Its core Statement Verification Pipeline reconstructs each agent’s ground-truth trajectory from engine logs and checks every discussion claim against it, automatically flagging spatial hallucination, unsupported accusation, deception collapse, and language-action inconsistency. Evaluating three frontier VLMs in both homogeneous and cross-model adversarial settings, we find that even the strongest agent hallucinates 15.1% of its verifiable spatial claims and 11.5% of accusations are strictly unsupported. We release the full engine, evaluation framework, toolkit, and logs in https://github.com/AAAAA-Academia-Attractions/QUACK.