Yiwen Wu
Author directory2026
Teach a Man to Fish: Self-Adaptive Reinforced Distillation for In-Context Reasoning-based Reranker
Wenwei Wu | Youhang LI | Mingyang Chen | Jie Yang | Xiaofeng Gu | Duyi Pan | Yiwen Wu | Kaichen Zhang | Wei Wang | Zixuan Yuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Wenwei Wu | Youhang LI | Mingyang Chen | Jie Yang | Xiaofeng Gu | Duyi Pan | Yiwen Wu | Kaichen Zhang | Wei Wang | Zixuan Yuan
Findings of the Association for Computational Linguistics: EMNLP 2026
Recent advances in Large Reasoning Models (LRMs) are reshaping reasoning-intensive reranking, where step-by-step reasoning enables multi-faceted relevance judgments. To scale LRMs, existing approaches distill chain-of-thought traces from a teacher LRM into a student reranker via Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL). However, this pipeline is misaligned with the distillation objective: teacher traces are too dense for direct imitation, while RL exploration is too sparse on hard cases. To this end, we propose SARD (Self-Adaptive Reinforced Distillation), a tri-mode RL framework that recasts teacher reasoning from a fixed supervision target into an adaptive resource the student draws on only when its own reasoning falls short. Triggered by rollout outcomes, SARD organizes training into three modes: Free Exploration, where the student reasons independently; Guided Exploration, which supplies reusable in-context guidance abstracted from teacher traces when free rollouts fail; and Teacher-Guided Repair, where the teacher diagnoses failures and revises, re-selects, or appends guidance, falling back to teacher trajectories only as a last resort. Experiments on reasoning-intensive reranking benchmarks show SARD outperforms strong reranking and SFT-then-RL baselines, with clear gains on difficult instances and under-represented reasoning patterns.
IDEA: An Interpretable and Editable Decision-Making Framework for LLMs via Verbal-to-Numeric Calibration
Yanji He | Yuxin Jiang | Yiwen Wu | Bo Huang | Jiaheng Wei | Wei Wang
Findings of the Association for Computational Linguistics: ACL 2026
Yanji He | Yuxin Jiang | Yiwen Wu | Bo Huang | Jiaheng Wei | Wei Wang
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models are increasingly deployed for decision-making, yet their adoption in high-stakes domains remains limited by miscalibrated probabilities, unfaithful explanations, and inability to incorporate expert knowledge precisely. We propose IDEA, a framework that extracts LLM decision knowledge into an interpretable parametric model over semantically meaningful factors. Through joint learning of verbal-to-numerical mappings and decision parameters via EM, correlated sampling that preserves factor dependencies, and direct parameter editing with mathematical guarantees, IDEA produces calibrated probabilities while enabling quantitative human-AI collaboration. Experiments across five datasets show IDEA with Qwen-3-32B (78.6%) outperforms DeepSeek R1 (68.1%) and GPT-5.2 (77.9%), achieving perfect factor exclusion and exact calibration—precision unattainable through prompting alone.
ChineseDevBench: A Chinese Developmental Benchmark for Language Development
Shaonan Wang | Yiwen Wu | Na Li | Zesheng Chen | Gan Wang | Shuchen Zhang | Xin Sun | Luan Li | Yaran Chen
Proceedings of the 15th Workshop on Cognitive Modeling and Computational Linguistics
Shaonan Wang | Yiwen Wu | Na Li | Zesheng Chen | Gan Wang | Shuchen Zhang | Xin Sun | Luan Li | Yaran Chen
Proceedings of the 15th Workshop on Cognitive Modeling and Computational Linguistics
2025
SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture
Jiayi Han | Liang Du | Hongwei Du | Xiangguo Zhou | Yiwen Wu | Yuanfang Zhang | Weibo Zheng | Donghong Han
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Jiayi Han | Liang Du | Hongwei Du | Xiangguo Zhou | Yiwen Wu | Yuanfang Zhang | Weibo Zheng | Donghong Han
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Despite the recent efforts from the NLP community, balancing the training budget, downstream performance, and general capabilities of large language models (LLM) remains a challenge in many applications. Training the entire model for downstream tasks is expensive, and could easily result in catastrophic forgetting. Parameter-efficient fine-tuning (PEFT) could reduce the training cost, but it still suffers from forgetting, and limits the learning on the downstream tasks. To address the aforementioned issues, we propose a novel mixture of expert (MoE) framework based on Soft LoRA and Identity Mixture (SLIM). SLIM allows dynamic routing between LoRA adapters and identity layers, thus enabling the bypass of LoRA adapters to suppress forgetting of general capacity. We adopt weight yielding with sliding clustering for better out-of-domain distinguish to enhance the routing. We also convert the mixture of LoRA adapters to the model merging formulation and introduce dynamic merging with its fast implementation for LoRA adapters to keep the general capabilities. Extensive experiments demonstrate that the proposed SLIM is comparable to the state-of-the-art PEFT approaches on the downstream tasks while achieving the leading performance in mitigating catastrophic forgetting. We plan to open-source the code upon publication.
AdaV: Adaptive Text-visual Redirection for Vision-Language Models
Jiayi Han | Liang Du | Yiwen Wu | Guanming Liang | Xiangguo Zhou | Weibo Zheng | Donghong Han | Zixun Sun
Findings of the Association for Computational Linguistics: ACL 2025
Jiayi Han | Liang Du | Yiwen Wu | Guanming Liang | Xiangguo Zhou | Weibo Zheng | Donghong Han | Zixun Sun
Findings of the Association for Computational Linguistics: ACL 2025
The success of Vision-Language Models (VLMs) often relies on high-resolution schemes that preserve image details, while these approaches also generate an excess of visual tokens, leading to a substantial decrease in model efficiency. A typical VLM includes a visual encoder, a text encoder, and an LLM. Recent studies suggest pruning visual tokens based on visual and textual priors to accelerate VLMs without additional training costs. However, these methods often overlook prompt semantics or suffer from biased self-attention in the LLM. Inspired by the efficient mechanisms of the human brain for multimodal understanding, we introduce AdaV, a novel training-free visual token pruning method. By emulating the neural pathways that preprocess visual and auditory information before the reasoning stage, we shift text-guided visual attention redirection to the pre-LLM stage, which reduces biased token pruning and enhances model robustness with a limited visual token budget. A Self-adaptive Cross-modality Attention Redirection (SCAR) module is further proposed that effectively merges and redirects visual attention with text-to-image attention. Extensive experiments on seven challenging benchmarks demonstrate that our AdaV achieves SOTA performance in training-free VLM acceleration and can be plug-and-play on various VLMs. We plan to open-source the code upon publication.
2024
How Grammatical Features Impact Machine Translation: A New Test Suite for Chinese-English MT Evaluation
Huacheng Song | Yi Li | Yiwen Wu | Yu Liu | Jingxia Lin | Hongzhi Xu
Proceedings of the Ninth Conference on Machine Translation
Huacheng Song | Yi Li | Yiwen Wu | Yu Liu | Jingxia Lin | Hongzhi Xu
Proceedings of the Ninth Conference on Machine Translation
Machine translation (MT) evaluation has evolved toward a trend of fine-grained granularity, enabling a more precise diagnosis of hidden flaws and weaknesses of MT systems from various perspectives. This paper examines how MT systems are potentially affected by certain grammatical features, offering insights into the challenges these features pose and suggesting possible directions for improvement. We develop a new test suite by extracting 7,848 sentences from a multi-domain Chinese-English parallel corpus. All the Chinese text was further annotated with 43 grammatical features using a semi-automatic method. This test suite was subsequently used to evaluate eight state-of-the-art MT systems according to six different automatic evaluation metrics. The results reveal intriguing patterns of MT performance associated with different domains and various grammatical features, highlighting the test suite’s effectiveness. The test suite was made publicly available and it will serve as an important benchmark for evaluating and diagnosing Chinese-English MT systems.
Search
Fix author
Co-authors
- Liang Du 2
- Donghong Han 2
- Jiayi Han 2
- Wei Wang 2
- Weibo Zheng 2
- Xiangguo Zhou 2
- Mingyang Chen 1
- Yaran Chen 1
- Zesheng Chen 1
- Hongwei Du 1
- Xiaofeng Gu 1
- Yanji He 1
- Bo Huang 1
- Yuxin Jiang 1
- Youhang LI 1
- Luan Li 1
- Na Li 1
- Yi Li 1
- Guanming Liang 1
- Jingxia Lin 1
- Yu Liu 1
- Duyi Pan 1
- Huacheng Song 1
- Xin Sun 1
- Zixun Sun 1
- Gan Wang 1
- Shaonan Wang 1
- Jiaheng Wei 1
- Wenwei Wu 1
- Hongzhi Xu 1
- Jie Yang 1
- Zixuan Yuan 1
- Kaichen Zhang 1
- Shuchen Zhang 1
- Yuanfang Zhang 1