Zihan Zhang

Author directory

Other people with similar names: Zihan Zhang, Zihan Zhang

Unverified author pages with similar names: Zihan Zhang


2026

Multimodal Sentiment Analysis (MSA) models typically suffer significant performance degradation under domain shifts. While Test-Time Adaptation (TTA) aims to mitigate this, existing discriminative approaches often succumb to “confident but wrong” predictions on out-of-distribution samples. Conversely, generative models offer robust calibration but incur prohibitive computational costs. To bridge this gap, we propose GD-Adapt (Generative-Discriminative Adaptation), a novel TTA framework that harmonizes the robustness of generative diffusion models with the efficiency of discriminative regression networks via Bayesian Diffusion Distillation (BDD). Specifically, we introduce Auxiliary Generative Regularization (AGR) during pretraining to enforce manifold-aware feature learning. Extensive experiments across five cross-domain scenarios demonstrate our method’s superiority. For instance, on the challenging MOSI to SIMS shift, GD-Adapt reduces Mean Absolute Error (MAE) from 0.6872 to 0.5673 and boosts binary accuracy by 5.81 percentage points (reaching 57.33%). Notably, in scenarios such as SIMS to MOSI, we achieve an 11.18-point gain over the non-adapted baseline.
While audio large language models have achieved remarkable progress in auditory perception, they still lag behind text-based large language models in deep logical reasoning capabilities. This performance disparity primarily stems from the scarcity of high-quality audio reasoning data. To bridge this modality gap, we propose a novel cross-modal on-policy distillation framework. Our approach leverages a powerful text model as a teacher to provide dynamic correction and guidance to the audio foundational model during on-policy exploration. Furthermore, we construct a three-tier symmetric dataset encompassing logical reasoning, complex audio reasoning, and speech dialogue. By dynamically aligning the student model’s reasoning trajectories within the high-noise auditory space with the teacher model’s prior knowledge in the clean text space, our method effectively distills robust reasoning capabilities into the audio domain. Extensive experiments demonstrate that our model achieves substantial improvements on the audio and speech understanding benchmarks, paving a new path for comprehensive audio-language understanding.