Yu Cheng
Author directoryOther people with similar names: Yu Cheng, Yu Cheng, Yu Cheng
Unverified author pages with similar names: Yu Cheng
2026
TabEmbed: Benchmarking and Learning Generalist Embeddings for Tabular Understanding
Minjie Qiang | Mingming Zhang | Xiaoyi Bao | Xing Fu | Yu Cheng | Weiqiang Wang | Zhongqing Wang | Ningtao Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Minjie Qiang | Mingming Zhang | Xiaoyi Bao | Xing Fu | Yu Cheng | Weiqiang Wang | Zhongqing Wang | Ningtao Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Foundation models have established unified representations for natural language processing, yet this paradigm remains largely unexplored for tabular data. Existing methods face fundamental limitations: LLM-based approaches lack retrieval-compatible vector outputs, whereas text embedding models often fail to capture tabular structure and numerical semantics. To bridge this gap, we first introduce the Tabular Embedding Benchmark (TabBench), a comprehensive suite designed to evaluate the tabular understanding capability of embedding models. We then propose TabEmbed, the first generalist embedding model that unifies tabular classification and retrieval within a shared embedding space. By reformulating diverse tabular tasks as semantic matching problems, TabEmbed leverages large-scale contrastive learning with positive-aware hard negative mining to discern fine-grained structural and numerical nuances. Experimental results on TabBench demonstrate that TabEmbed significantly outperforms state-of-the-art text embedding models, establishing a new baseline for universal tabular representation learning.
OmniDA: Grounding Agentic Multimodal Data Analysis with Evidence-Aware Process Rewards
Xuhang Zhu | Liyao Li | Ningtao Wang | Yanyu Chen | Hao Chen | Wentao Ye | Ziquan Wang | Haoxing Zhai | Yu Cheng | Gang Chen | Xiu Tang | Haobo Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Xuhang Zhu | Liyao Li | Ningtao Wang | Yanyu Chen | Hao Chen | Wentao Ye | Ziquan Wang | Haoxing Zhai | Yu Cheng | Gang Chen | Xiu Tang | Haobo Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Real-world data analysis often requires joint reasoning over heterogeneous artifacts such as tables, charts, and textual reports. Training reliable multimodal large language model (MLLM) agents for this setting remains challenging, as large-scale aligned training data are scarce, and outcome-only rewards are too coarse to distinguish grounded cross-source analysis from spurious success. We introduce OmniDA, a training recipe that addresses these two challenges with a scalable multimodal data-synthesis pipeline and an Evidence-Aware Process Reward (EAPR) that supervises both evidence recovery and procedural validity. Through this pipeline, we construct OmniDA-11K, a high-quality training corpus for multimodal data analysis. When instantiated with Qwen3-VL-8B, OmniDA improves over the corresponding agentic baseline by 19.2 points on average across five challenging benchmarks and achieves the strongest overall performance among existing open-source data-analysis agents. These results highlight the value of supervising evidence recovery and analytical procedure beyond final-answer correctness.
TSPO: Breaking the Double Homogenization Dilemma in Multi-turn Search Policy Optimization
Shichao Ma | Zhiyuan Ma | Ming Yang | Xiaofan Li | Xing Wu | Jintao Du | Yu Cheng | Weiqiang Wang | Qiliang Liu | Zhengyang Zhou | Yang Wang
Findings of the Association for Computational Linguistics: ACL 2026
Shichao Ma | Zhiyuan Ma | Ming Yang | Xiaofan Li | Xing Wu | Jintao Du | Yu Cheng | Weiqiang Wang | Qiliang Liu | Zhengyang Zhou | Yang Wang
Findings of the Association for Computational Linguistics: ACL 2026
Multi-turn tool-integrated reasoning enables Large Language Models (LLMs) to solve complex tasks through iterative information retrieval. However, current reinforcement learning (RL) frameworks for search-augmented reasoning predominantly rely on sparse outcome-level rewards, leading to a “Double Homogenization Dilemma.” This manifests as (1) Process homogenization, where the thinking, reasoning, and tooling involved in generation are ignored. (2) Intra-group homogenization, coarse-grained outcome rewards often lead to inefficiencies in intra-group advantage estimation with methods like Group Relative Policy Optimization (GRPO) during sampling. To address this, we propose Turn-level Stage-aware Policy Optimization (TSPO). TSPO introduces the First-Occurrence Latent Reward (FOLR) mechanism, allocating partial rewards to the step where the ground-truth answer first appears, thereby preserving process-level signals and increasing reward variance within groups without requiring external reward models or any annotations. Extensive experiments demonstrate that TSPO significantly outperforms state-of-the-art baselines, achieving average performance gains of 24% and 13.6% on Qwen2.5-3B and 7B models, respectively. Code is available at https://github.com/Flipped-May/TSPO.
2025
Training LLMs to be Better Text Embedders through Bidirectional Reconstruction
Chang Su | Dengliang Shi | Siyuan Huang | Jintao Du | Changhua Meng | Yu Cheng | Weiqiang Wang | Zhouhan Lin
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Chang Su | Dengliang Shi | Siyuan Huang | Jintao Du | Changhua Meng | Yu Cheng | Weiqiang Wang | Zhouhan Lin
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) have increasingly been explored as powerful text embedders. Existing LLM-based text embedding approaches often leverage the embedding of the final token, typically a reserved special token such as ‘[EOS]‘. However, these tokens have not been intentionally trained to capture the semantics of the whole context, limiting their capacity as text embeddings, especially for retrieval and re-ranking tasks. We propose to add a new training stage before contrastive learning to enrich the semantics of the final token embedding. This stage employs bidirectional generative reconstruction tasks, namely EBQ2D (Embedding-Based Query-to-Document) and EBD2Q (Embedding-Based Document-to-Query), which interleave to anchor the ‘[EOS]‘ embedding and reconstruct either side of Query-Document pairs. Experimental results demonstrate that our additional training stage significantly improves LLM performance on the Massive Text Embedding Benchmark (MTEB), achieving new state-of-the-art results across different LLM base models and scales.
Search
Fix author
Co-authors
- Weiqiang Wang (王维强) 3
- Jintao Du 2
- Ningtao Wang 2
- Xiaoyi Bao 1
- Gang Chen 1
- Hao Chen 1
- Yanyu Chen 1
- Xing Fu 1
- Siyuan Huang 1
- Liyao Li 1
- Xiaofan Li 1
- Zhouhan Lin 1
- Qiliang Liu 1
- Shichao Ma 1
- Zhiyuan Ma 1
- Changhua Meng 1
- Minjie Qiang 1
- Dengliang Shi 1
- Chang Su 1
- Xiu Tang 1
- Haobo Wang 1
- Yang Wang 1
- Zhongqing Wang (王中卿) 1
- Ziquan Wang 1
- Xing Wu 1
- Ming Yang 1
- Wentao Ye 1
- Haoxing Zhai 1
- Mingming Zhang (张明明) 1
- Zhengyang Zhou 1
- Xuhang Zhu 1