2026

Audio-Language Models (ALMs) natively fuse lexical content with continuous paralinguistic acoustics such as intonation, tone, and speaker identity. While considerable progress has been made in aligning the semantic outputs of text-based models against harmful instructions, current ALM safety alignment evaluation largely treats speech as a noisy text channel, leaving modality-specific vulnerabilities unexamined. In this work, we introduce and investigate Prosody-Conditioned Safety Divergence: a vulnerability where an ALM’s safety behavior shifts systematically based entirely on paralinguistic variation, even when lexical semantic payload is held completely constant. Rather than assuming the existence of coarse, high-variance acoustic "authority" subspaces, we conduct a controlled causal analysis to track how specific prosodic manipulations—including variations in pitch contour and intensity—interact with safety-associated latent directions across the encoder, projector, and decoder layers. Our preliminary empirical evaluations characterize the localization of this divergence, establishing a framework for targeted inference-time interventions that restore alignment metrics without compromising baseline utility on benign speech tasks.