Yuxuan Wang

Author directory

Other people with similar names: Yuxuan Wang, Yuxuan Wang, Yuxuan Wang

Unverified author pages with similar names: Yuxuan Wang


2026

While Chain-of-Thought (CoT) reasoning has revolutionized text-based LLMs, its application to the audio modality reveals a counter-intuitive thinking paradox: forcing models to “think” via prompting or post-training often degrades performance compared to direct answering. In this work, we investigate the bottleneck of audio reasoning and reveal a critical insight: the primary constraint is not the model’s logical deduction capability, but its inability to accurately perceive acoustic details. We demonstrate that keeping perceptual cues effectively activates the LALM’s internal reasoning potential. Building on this finding, we propose Audio-ReaPer, a post-training framework and corresponding model designed to unlock Reasoning potential by explicitly fortifying Perception. Our approach reforms the post-training paradigm through three key strategies: (1) utilizing agentic data generation pipeline to synthesize perception-enhanced data for SFT; (2) curating perception-focused data for RLVR; and (3) introducing a novel perceptual density reward during RL to stabilize the learning process and balance observation with deduction. Extensive experiments show that Audio-ReaPer establishes a new state-of-the-art on benchmarks such as MMAU, MMAU-Pro, and MMAR. Notably, our 7B model outperforms previous open-source models by significant margins and surpasses proprietary models like GPT-4o Audio and Gemini 2.5 Flash. The model and code will be open-source to facilitate further research for audio reasoning.
AI models capable of comprehending humor hold real-world promise—for example, enhancing engagement in human-machine interactions. To gauge and diagnose the capacity of multimodal large language models (MLLMs) for humor understanding, we introduce v-HUB, a novel video humor understanding benchmark. v-HUB comprises a curated collection of non-verbal short videos, reflecting real-world scenarios where humor can be appreciated purely through visual cues. We pair each video clip with rich annotations to support a variety of evaluation tasks and analyses, including a novel study of environmental sound that can enhance humor. To broaden its applicability, we construct an open-ended QA task, making v-HUB readily integrable into existing video understanding task suites. We evaluate a diverse set of MLLMs, from specialized Video-LLMs to versatile OmniLLMs that can natively process audio, covering both open-source and proprietary domains. The experimental results expose the difficulties MLLMs face in comprehending humor from visual cues alone. Our findings also demonstrate that incorporating audio helps with video humor understanding, highlighting the promise of integrating richer modalities for complex video understanding tasks.

2025

Recent researches on video large language models (VideoLLM) predominantly focus on model architectures and training datasets, leaving the interaction format between the user and the model under-explored. In existing works, users often interact with VideoLLMs by using the entire video and a query as input, after which the model generates a response. This interaction format constrains the application of VideoLLMs in scenarios such as live-streaming comprehension where videos do not end and responses are required in a real-time manner, and also results in unsatisfactory performance on time-sensitive tasks that requires localizing video segments. In this paper, we focus on a video-text duet interaction format. This interaction format is characterized by the continuous playback of the video, and both the user and the model can insert their text messages at any position during the video playback. When a text message ends, the video continues to play, akin to the alternative of two performers in a duet. We construct MMDuetIT, a video-text training dataset designed to adapt VideoLLMs to video-text duet interaction format. We also introduce the Multi-Answer Grounded Video Question Answering (MAGQA) task to benchmark the real-time response ability of VideoLLMs. Trained on MMDuetIT, MMDuet demonstrates that adopting the video-text duet interaction format enables the model to achieve significant improvements in various time-sensitive tasks (76% CIDEr on YouCook2 dense video captioning, 90% mAP on QVHighlights highlight detection and 25% R@0.5 on Charades-STA temporal video grounding) with minimal training efforts, and also enable VideoLLMs to reply in a real-time manner as the video plays.

2024

Despite progress in multimodal large language models (MLLMs), the challenge of interpreting long-form videos in response to linguistic queries persists, largely due to the inefficiency in temporal grounding and limited pre-trained context window size. In this work, we introduce Temporal Grounding Bridge (TGB), a novel framework that bootstraps MLLMs with advanced temporal grounding capabilities and broadens their contextual scope. Our framework significantly enhances the temporal capabilities of current MLLMs through three key innovations: an efficient multi-span temporal grounding algorithm applied to low-dimension temporal features projected from flow; a multimodal length extrapolation training paradigm that utilizes low-dimension temporal features to extend the training context window size; and a bootstrapping framework that bridges our model with pluggable MLLMs without requiring annotation. We validate TGB across seven video benchmarks and demonstrate substantial performance improvements compared with prior MLLMs. Notably, our model, initially trained on sequences of four frames, effectively handles sequences up to 16 longer without sacrificing performance, highlighting its scalability and effectiveness in real-world applications. Our code is publicly available.