Danh Vinh Le

Author directory

2026

Deploying high-dimensional Vision-Language Model (VLM) embeddings is computationally prohibitive. While Matryoshka Representation Learning (MRL) allows elastic truncation, standard MRL optimizes dimensional hierarchies semi-independently. This lack of cross-scale structural constraints creates a severe topological disconnect causing representational collapse at lower dimensions and introduces optimization trade-offs that compromise high-dimensional capacity. To solve this, we propose **M-VLM2Vec**, a framework that shifts MRL from a compromised hierarchy to a synergistic geometric structure. Without additional supervision, we integrate two novel constraints into the multimodal contrastive objective: (1) Laplacian spectral alignment to preserve the global manifold topology across scales, and (2) Stiefel-constrained orthogonal projection to bidirectionally align local contrastive landscapes. By allowing nested spaces to mutually regularize, M-VLM2Vec eliminates competing gradients, preventing ultra-low-dimensional collapse while yielding striking, consistent performance gains across all embedding scales on the Multimodal Embedding Benchmark (MMEB).