Yan Li
Author directoryOther people with similar names: Yan Li, Yan Li
Unverified author pages with similar names: Yan Li
2026
Is Reasoning Always Useful? Rethinking Reasoning Utility in Universal Multimodal Embeddings
Wenxiao Fan | Jingling Fu | Luohang Liu | Xinyuan Shan | Lichen Ma | Yu He | Junshi Huang | Yan Li | Kan Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Wenxiao Fan | Jingling Fu | Luohang Liu | Xinyuan Shan | Lichen Ma | Yu He | Junshi Huang | Yan Li | Kan Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Reasoning-enhanced universal multimodal embeddings (UME) improve heterogeneous retrieval, but plausible rationales do not necessarily produce discriminative rankings. We study this gap by comparing the discriminative (DISC) and reasoning-driven generative (GEN) branches of UME-R1, a state-of-the-art reasoning UME method. We decompose reasoning utility into positive-target gain, hard-negative gain, and their margin difference. Positive similarity increases for 56.6%, but 15.7% are false-helpful cases where reasoning moves hard negatives closer even more. Local-neighborhood and token-attribution diagnostics suggest why: reasoning often de-condenses retrieved neighborhoods, but utility requires separator-aligned movement, while influential CoT tokens frequently encode evidence shared by positives and hard negatives. Motivated by these diagnostics, we propose SURE (Score-structure Utility Router for Embeddings), which improves UME-R1-7B by 1.5 points and yields consistent gains on two additional embedding models on MMEB-V2, without retraining, label-based policy selection, or extra VLM forward passes.
FlowTrain: Flow-Based Decoupled Training for Industrial-Grade Vision-Language Models
Zhida Jiang | Zhaolong Xing | Pei Yang | Xiaolong Chen | Yuanhang Xiao | Chengzhi Huang | Xiyu Liu | Haopeng Liu | Qingyuan Sang | Lingfeng Zhou | Jiaxing Wang | Zicheng Zhang | Wenzhe Wang | Liuxinyu | Yan Li | Zhen Chen | Ke Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Zhida Jiang | Zhaolong Xing | Pei Yang | Xiaolong Chen | Yuanhang Xiao | Chengzhi Huang | Xiyu Liu | Haopeng Liu | Qingyuan Sang | Lingfeng Zhou | Jiaxing Wang | Zicheng Zhang | Wenzhe Wang | Liuxinyu | Yan Li | Zhen Chen | Ke Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Industrial-grade distributed training of vision-language models (VLMs) remains far less efficient than that of unimodal LLMs. Existing solutions either follow a monolithic design that assigns uniform parallelism to heterogeneous modules or adopt a disaggregated deployment that separates modules while executing them as a batch-synchronized pipeline. In this paper, we highlight that the above solutions are still not sufficient, and VLM training can be further decoupled. To this end, we present FlowTrain, a flow-based decoupled training framework that reformulates VLM training as a producer-consumer dataflow coordinated through a unified memory pool. The encoder and backbone can progress independently over a global virtual address space. Since this execution decoupling fundamentally changes the optimization objective of allocation and scheduling, FlowTrain further introduces a heterogeneous parallel allocator that assigns module-specific parallelism strategies by solving a throughput matching problem. The dynamic packing scheduler is used to construct balanced microbatches at runtime according to the actual LLM-side computation cost. Extensive experiments on real-world workloads show that FlowTrain achieves over 50% MFU and up to 1.7× throughput improvement, narrowing the efficiency gap to LLM-only training.