Ruxiao Chen
Author directory2026
Pragmatic Semantic Communication of Scene Description for Blind and Low-Vision Users
Peng Wu | Ruxiao Chen | Shuaishuai Guo
The Proceedings of Speech and Audio Language Models Workshop (2nd Edition)
Peng Wu | Ruxiao Chen | Shuaishuai Guo
The Proceedings of Speech and Audio Language Models Workshop (2nd Edition)
Artificial intelligence (AI) assistants for blind and low-vision (BLV) users deliver scene descriptions through a serial auditory channel, often followed by spoken user queries. A central challenge is that scene-description pipelines typically prioritize visually or corpus-salient content, whereas users’ follow-up questions often depend on low-salience attributes that are omitted during generation or compression. To diagnose where this mismatch arises, we introduce an encoder-agnostic framework that decomposes scene-description systems into four stages: visual encoding, length control, content selection, and audio scheduling. Applying this framework to 200 blind-user-captured VizWiz images and 500 questions reveals a salience–relevance mismatch: salience-based compression preserves identity information but discards low-salience attributes needed for attribute-bound questions. Improving the visual-encoding stage by replacing BLIP-base with stronger open-weight MLLMs raises semantic retention but does not eliminate this mismatch. As a lightweight repair, we propose CA-Keyword, which explicitly preserves attribute terms and recovers color-question answerability by 0.23 while producing descriptions 37% shorter than the sentence/
2025
From Perceptions to Decisions: Wildfire Evacuation Decision Prediction with Behavioral Theory-informed LLMs
Ruxiao Chen | Chenguang Wang | Yuran Sun | Xilei Zhao | Susu Xu
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Ruxiao Chen | Chenguang Wang | Yuran Sun | Xilei Zhao | Susu Xu
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Evacuation decision prediction is critical for efficient and effective wildfire response by helping emergency management anticipate traffic congestion and bottlenecks, allocate resources, and minimize negative impacts. Traditional statistical methods for evacuation decision prediction fail to capture the complex and diverse behavioral logic of different individuals. In this work, for the first time, we introduce FLARE, short for facilitating LLM for advanced reasoning on wildfire evacuation decision prediction, a Large Language Model (LLM)-based framework that integrates behavioral theories and models to streamline the Chain-of-Thought (CoT) reasoning and subsequently integrate with memory-based Reinforcement Learning (RL) module to provide accurate evacuation decision prediction and understanding. Our proposed method addresses the limitations of using existing LLMs for evacuation behavioral predictions, such as limited survey data, mismatching with behavioral theory, conflicting individual preferences, implicit and complex mental states, and intractable mental state-behavior mapping. Experiments on three post-wildfire survey datasets show an average of 20.47% performance improvement over traditional theory-informed behavioral models, with strong cross-event generalizability. Our complete code is publicly available at https://github.com/SusuXu-s-Lab/FLARE