Fan Yang
Author directoryOther people with similar names: Fan Yang, Fan Yang, Fan Yang, Fan Yang, Fan Yang, Fan Yang, Fan Yang, Fan Yang, Fan Yang
Unverified author pages with similar names: Fan Yang
2026
LaME: Learning to Think in Latent Space for Multimodal Embedding via Information Bottleneck
Peixi Wu | Biao Yang | Feipeng Ma | Bosong Chai | Bo Lin | Wei Yuan | Fan Yang | Tingting Gao | Hebei Li | Xiaoyan Sun
Findings of the Association for Computational Linguistics: EMNLP 2026
Peixi Wu | Biao Yang | Feipeng Ma | Bosong Chai | Bo Lin | Wei Yuan | Fan Yang | Tingting Gao | Hebei Li | Xiaoyan Sun
Findings of the Association for Computational Linguistics: EMNLP 2026
Reasoning-driven universal multimodal embedding has advanced rapidly by introducing Chain-of-Thought (CoT) reasoning into the embedding pipeline. Despite the strong performance across both general and complex tasks, this paradigm suffers from two core limitations: (i) autoregressive CoT reasoning incurs high computational cost, making it impractical for low-latency retrieval; and (ii) embedding performance is heavily coupled with CoT annotation quality, making large-scale training unreliable. These raise fundamental questions:Is textual CoT the optimal form of reasoning for embedding, and can effective embedding reasoning be accomplished in latent space? To this end, we propose LaME (Latent Reasoning Multimodal Embedding), which formulates embedding-oriented latent reasoning as a weakly supervised information bottleneck. LaME employs K learnable reason tokens as a fixed-capacity bottleneck, completing all reasoning within a single forward pass. The two weak supervision signals structurally decouple contrastive from autoregressive objectives and eliminate dependence on CoT annotations, while a two-stage training pipeline ensures stable convergence. Experiments on MMEB-v2 and MRMR show that LaME achieves competitive performance, surpassing some explicit CoT-based models, while delivering 60× faster inference than explicit CoT methods and 2× faster than latent baselines with throughput comparable to discriminative embedding models. The code is available at https://github.com/PeppaWu/LaME.
Why Can Distillation Work with Limited Resources? A Systematic Study
Xiao Hu | Xingyu Lu | Liyuan Mao | YiFan Zhang | Tianke Zhang | Bin Wen | Fan Yang | Tingting Gao | Guorui Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Xiao Hu | Xingyu Lu | Liyuan Mao | YiFan Zhang | Tianke Zhang | Bin Wen | Fan Yang | Tingting Gao | Guorui Zhou
Findings of the Association for Computational Linguistics: ACL 2026
Recently, large language models have made remarkable progress in reasoning, largely driven by scaling data and model size. In parallel, several studies argue that for smaller models, high-quality distillation can yield strong reasoning performance with minimal resources. However, a framework for understanding machine reasoning that explains why low-resource distillation can boost model performance is still missing. In this paper, we conduct a controlled case study: using less than 920 examples, a simple distillation based on the base model can actually achieve notable reasoning performance improvement, compared with the base model and even the zero-RL models. By analyzing the token frequency in model outputs, we find that the distilled model shows more flexible reasoning. It uses anthropomorphic tokens and logical connectors much more often than the base and zero-RL model. Further analysis reveals that distillation enhances the presence of two advanced cognitive behaviors: Multi-Perspective Thinking or Attempting and Metacognitive Awareness. Frequent occurrences of these two advanced cognitive behaviors give rise to flexible reasoning, which is essential for solving reasoning problems.
Awakening Dormant Users: Modeling Intent Evolution via LLM-based Functional Role Reasoning for Generative Recommendation
Huishi Luo | Shuokai Li | Hanchen Yang | Zhongbo Sun | Haojie Ding | Boheng Zhang | Zijia Cai | Renliang Qian | Fan Yang | Tingting Gao | Chenyi Lei | Wenwu Ou | Fuzhen Zhuang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Huishi Luo | Shuokai Li | Hanchen Yang | Zhongbo Sun | Haojie Ding | Boheng Zhang | Zijia Cai | Renliang Qian | Fan Yang | Tingting Gao | Chenyi Lei | Wenwu Ou | Fuzhen Zhuang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Awakening dormant users, who remain engaged but exhibit low conversion, is a key driver for incremental GMV growth in e-commerce platforms. Existing methods often underperform since they typically rely on single-step estimation of an item’s intrinsic value (e.g., immediate click probability). This overlooks the instrumental effect of items, where specific interactions act as triggers to shape latent intent and drive subsequent decisions along a conversion trajectory. To bridge this gap, we propose RoleGen, a framework that synergizes a Conversion Trajectory Reasoner with a Generative Collaborative Executor. Specifically, the LLM-based Reasoner explicitly models the context-dependent Functional Role of items to reconstruct intent evolution. It further uses counterfactual role exploration to mitigate interest collapse and generate diverse conversion-oriented candidates. These reasoned candidate items are then injected into the Executor, which is optimized via a feedback-driven co-training mechanism to ensure grounded execution. Extensive offline experiments and online A/B testing on a large-scale e-commerce platform show a 5.82% gain in Recall@1 and a 6.71% increase in online order volume, confirming RoleGen’s effectiveness in activating dormant users.
Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding
Da Li | Yuxiao Luo | Keping Bi | Jiafeng Guo | Wei Yuan | Biao Yang | Yan Wang | Fan Yang | Tingting Gao | Guorui Zhou
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Da Li | Yuxiao Luo | Keping Bi | Jiafeng Guo | Wei Yuan | Biao Yang | Yan Wang | Fan Yang | Tingting Gao | Guorui Zhou
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Multimodal Large Language Models advance multimodal representation learning by acquiring transferable semantic embeddings, thereby substantially enhancing performance across a range of vision-language tasks, including cross-modal retrieval, clustering, and classification. An effective embedding is expected to comprehensively preserve the semantic content of the input while simultaneously emphasizing features that are discriminative for downstream tasks. Recent approaches demonstrate that MLLMs can be adapted into competitive embedding models via large-scale contrastive learning, enabling the simultaneous optimization of two complementary objectives. We argue that the two aforementioned objectives can be decoupled: a comprehensive understanding of the input enables the embedding model to achieve superior performance on downstream tasks via contrastive learning. In this paper, we propose CoMa, a compressed pre-training phase, which serves as a warm-up stage for contrastive learning. Experiments demonstrate that with only a small amount of pre-training data, we can transform an MLLM into a competitive embedding model. CoMa achieves new state-of-the-art results among MLLMs of comparable size on the MMEB, realizing optimization in both efficiency and effectiveness. Our project is available at https://github.com/Trustworthy-Information-Access/CoMa.
2025
iMOVE : Instance-Motion-Aware Video Understanding
Jiaze Li | Yaya Shi | Zongyang Ma | Haoran Xu | Feng cheng | Huihui Xiao | Ruiwen Kang | Fan Yang | Tingting Gao | Di Zhang
Findings of the Association for Computational Linguistics: ACL 2025
Jiaze Li | Yaya Shi | Zongyang Ma | Haoran Xu | Feng cheng | Huihui Xiao | Ruiwen Kang | Fan Yang | Tingting Gao | Di Zhang
Findings of the Association for Computational Linguistics: ACL 2025
Enhancing the fine-grained instance spatiotemporal motion perception capabilities of Video Large Language Models is crucial for improving their temporal and general video understanding. However, current models struggle to perceive detailed and complex instance motions. To address these challenges, we have made improvements from both data and model perspectives. In terms of data, we have meticulously curated iMOVE-IT, the first large-scale instance-motion-aware video instruction-tuning dataset. This dataset is enriched with comprehensive instance motion annotations and spatiotemporal mutual-supervision tasks, providing extensive training for the model’s instance-motion-awareness. Building on this foundation, we introduce iMOVE, an instance-motion-aware video foundation model that utilizes Event-aware Spatiotemporal Efficient Modeling to retain informative instance spatiotemporal motion details while maintaining computational efficiency. It also incorporates Relative Spatiotemporal Position Tokens to ensure awareness of instance spatiotemporal positions. Evaluations indicate that iMOVE excels not only in video temporal understanding and general video understanding but also demonstrates significant advantages in long-term video understanding. We will release the data, code, and model weights after acceptance.
Search
Fix author
Co-authors
- Tingting Gao 5
- Biao Yang 2
- Wei Yuan 2
- Guorui Zhou 2
- Yandong Bai 1
- Keping Bi 1
- Zijia Cai 1
- Bosong Chai 1
- Haojie Ding 1
- Jiafeng Guo (嘉丰 郭) 1
- Xiao Hu 1
- Ruiwen Kang 1
- Chenyi Lei 1
- Da Li 1
- Hebei Li 1
- Jiaze Li 1
- Shuokai Li 1
- Bo Lin 1
- Xingyu Lu 1
- Huishi Luo 1
- Yuxiao Luo 1
- Feipeng Ma 1
- Zongyang Ma 1
- Liyuan Mao 1
- Wenwu Ou 1
- Renliang Qian 1
- Yaya Shi 1
- Xiaoyan Sun 1
- Zhongbo Sun 1
- Yan Wang 1
- Bin Wen 1
- Peixi Wu 1
- Huihui Xiao 1
- Haoran Xu 1
- Hanchen Yang 1
- Boheng Zhang 1
- Di Zhang 1
- Tianke Zhang 1
- YiFan Zhang 1
- Fuzhen Zhuang 1