Tianyu Shi
Author directory2026
Stable-MM-R1: Anchoring Multimodal Reasoning Dynamics via Entropy-Guided Stratification
Yimeng Ye | Shuang Chen | Wenxuan Huang | Manyuan Zhang | Kaituo Feng | Zhangquan Chen | Jiayu Chen | Yucheng Zhou | YiCheng Xiao | ZhiYuan Feng | Tianyu Shi
Findings of the Association for Computational Linguistics: EMNLP 2026
Yimeng Ye | Shuang Chen | Wenxuan Huang | Manyuan Zhang | Kaituo Feng | Zhangquan Chen | Jiayu Chen | Yucheng Zhou | YiCheng Xiao | ZhiYuan Feng | Tianyu Shi
Findings of the Association for Computational Linguistics: EMNLP 2026
While Reinforcement Learning (RL) effectively incentivizes reasoning in Large Language Models, current pipelines are hindered by training instability and rapid entropy collapse. These limitations often stem from "Rollout Silencing" and low-quality gradient signals in standard sampling procedures. In this work, we propose a robust, data-centric framework to stabilize RL training. We first introduce Potential-Aware Query Mining (PAQM), which filters data dynamically to focus on the "Distillation Zone"—samples with high potential for capability elicitation. Furthermore, we present Hybrid Stratified Replay (HSR), a novel mechanism that restructures batches by stratifying rollouts based on Path Entropy, a rollout-level confidence proxy, and outcome reward. Within each optimization step, HSR reuses current-policy "Stability Anchors" and "Hard Negatives" to construct high-contrast optimization groups, then clears its buffers before the next step. This approach mitigates entropy collapse while improving the utilization of learning signals under limited compute. Our method outperforms strong baselines on complex reasoning tasks, offering a principled solution for stable and efficient RL fine-tuning.
ComfySearch: Autonomous Exploration and Reasoning for ComfyUI Workflows
Jinwei Su | Qizhen Lan | Zeyu Wang | Yinghui Xia | Hairu Wen | Yiqun Duan | Xi Xiao | Yang Jingsong | Lewei He | Tianyu Shi
Findings of the Association for Computational Linguistics: EMNLP 2026
Jinwei Su | Qizhen Lan | Zeyu Wang | Yinghui Xia | Hairu Wen | Yiqun Duan | Xi Xiao | Yang Jingsong | Lewei He | Tianyu Shi
Findings of the Association for Computational Linguistics: EMNLP 2026
AI-generated content has progressed from monolithic models to modular workflows, especially on platforms like ComfyUI, allowing users to customize complex creative pipelines. However, the large number of components in ComfyUI and the difficulty of maintaining long-horizon structural consistency under strict graph constraints frequently lead to low pass rates and workflows of limited quality. To tackle these limitations, we present ComfySearch, an agentic framework that can effectively explore the component space and generate functional ComfyUI pipelines via validation-guided workflow construction. Experiments demonstrate that ComfySearch substantially outperforms existing methods on complex and creative tasks, achieving higher executability (pass) rates, higher solution rates, and stronger generalization.
MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification
Jingwei Song | Xinyu Wang | Hanbin Wang | Xiaoxuan Lei | Tianyu Shi | Shixin Han | Eric Yang | Xiao-Wen Chang | Lynn Ai
Findings of the Association for Computational Linguistics: ACL 2026
Jingwei Song | Xinyu Wang | Hanbin Wang | Xiaoxuan Lei | Tianyu Shi | Shixin Han | Eric Yang | Xiao-Wen Chang | Lynn Ai
Findings of the Association for Computational Linguistics: ACL 2026
Speculative Decoding (SD) accelerates autoregressive large language model (LLM) inference by decoupling generation and verification. While recent methods improve draft quality by tightly coupling the drafter with the target model, the verification mechanism itself remains largely unchanged, relying on strict token-level rejection sampling. In practice, modern LLMs frequently operate in low-margin regimes where the target model exhibits weak preference among top candidates. In such cases, rejecting plausible runner-up tokens yields negligible information gain while incurring substantial rollback cost, leading to a fundamental inefficiency in verification.We propose Margin-Aware Speculative Verification, a training-free and domain-agnostic verification strategy that adapts to the target model’s local decisiveness. Our method conditions verification on decision stability measured directly from the target logits and relaxes rejection only when strict verification provides minimal benefit. Importantly, the approach modifies only the verification rule and is fully compatible with existing target-coupled speculative decoding frameworks. Extensive experiments across model scales ranging from 8B to 235B demonstrate that our method delivers consistent and significant inference speedups over state-of-the-art baselines while preserving generation quality across diverse benchmarks. The code is available at https://github.com/5SSjw/MARS.
DynaWeb: Model-Based Reinforcement Learning of Web Agents
Hang Ding | Peidong Liu | Junqiao Wang | Ziwei Ji | Meng Cao | Rongzhao Zhang | Lynn Ai | Eric Yang | Tianyu Shi | Lei Yu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hang Ding | Peidong Liu | Junqiao Wang | Ziwei Ji | Meng Cao | Rongzhao Zhang | Lynn Ai | Eric Yang | Tianyu Shi | Lei Yu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
The development of autonomous web agents, powered by Large Language Models (LLMs) and reinforcement learning (RL), represents a significant step towards general-purpose AI assistants. However, training these agents is severely hampered by the challenges of interacting with the live internet, which is inefficient, costly, and fraught with risks. Model-based reinforcement learning (MBRL) offers a promising solution by learning a world model of the environment to enable simulated interaction. This paper introduces DynaWeb, a novel MBRL framework that trains web agents through interacting with a web world model trained to predict naturalistic web page representations given agent actions. This model serves as a synthetic web environment where an agent policy can dream by generating vast quantities of rollout action trajectories for efficient online reinforcement learning. Beyond free policy rollouts, DynaWeb incorporates real expert trajectories from training data, which are randomly interleaved with on-policy rollouts during training to improve stability and sample efficiency. Experiments conducted on the challenging WebArena and WebVoyager benchmarks demonstrate that DynaWeb consistently and significantly improves the performance of state-of-the-art open-source web agent models. Our findings establish the viability of training web agents through imagination, offering a scalable and efficient way to scale up online agentic RL.
PeopleSearchBench: Evaluating AI-Powered People Search Platforms with Criteria-Grounded Verification
Tianyu Shi | Wei Wang | Zequn Xie | Shuai Zhang | Boyang Xia | Chenyu Zeng | QI Zhang | Lynn Ai | YU Yaqi | Kaiming Zhang | Feiyue Tang | Zhenyu Yu | Lei Ding
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Tianyu Shi | Wei Wang | Zequn Xie | Shuai Zhang | Boyang Xia | Chenyu Zeng | QI Zhang | Lynn Ai | YU Yaqi | Kaiming Zhang | Feiyue Tang | Zhenyu Yu | Lei Ding
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Al-powered people search platforms are increasingly deployed for recruiting, sales prospecting, and professional networking, yet no standardized benchmark exists for their rigorous evaluation. We present PEOPLESEARCHBENCH, an open-source benchmark comprising 119 multilingual queries across four scenarios: corporate recruiting, B2B sales prospecting, expert search, and influencer discovery. A central contribution is Criteria-Grounded Verification, an evaluation methodology that decomposes each query into explicit, independently checkable criteria and verifies each returned individual via live web search, producing factual relevance judgments rather than subjective LLM-as-judge scores. We evaluate four architecturally diverse platforms along three complementary dimensions-Relevance Precision, Effective Coverage, and Information Utility-and find that multi-source search agents significantly outperform single-domain systems, particularly in influencer discovery where the performance gap is largest. Platform rankings are robust across ablations on scoring thresholds, dimension weights, and judge models. All code, queries, and evaluation prompts are publicly available.
EVM-QuestBench: An Execution-Grounded Benchmark for Natural-Language Transaction Code Generation
Pei Yang | Wanyi Chen | Ke Wang | Lynn Ai | Eric Yang | Tianyu Shi
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Pei Yang | Wanyi Chen | Ke Wang | Lynn Ai | Eric Yang | Tianyu Shi
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models are increasingly applied to various development scenarios. However, in on-chain transaction scenarios, even a minor error can cause irreversible loss for users. Existing evaluations often overlook execution accuracy and safety. We introduce EVM-QuestBench, an execution-grounded benchmark for natural-language transaction-script generation on EVM-compatible chains. The benchmark employs dynamic evaluation: instructions are sampled from template pools, numeric parameters are drawn from predefined intervals, and validators verify outcomes against these instantiated values. EVM-QuestBench contains 107 tasks (62 atomic, 45 composite). Its modular architecture enables rapid task development. The runner executes scripts on a forked EVM chain with snapshot isolation; composite tasks apply step-efficiency decay. We evaluate 20 models with 5 independent rounds each and find large performance gaps, with split scores revealing persistent asymmetry between single-action precision and multi-step workflow completion. Code: https://github.com/OpenEdgeHQ/EVM-quest-bench.
2025
VisualEDU: A Benchmark for Assessing Coding and Visual Comprehension through Educational Problem-Solving Video Generation
Hao Chen | Tianyu Shi | Pengran Huang | Zeyuan Li | Jiahui Pan | Qianglong Chen | Lewei He
Findings of the Association for Computational Linguistics: EMNLP 2025
Hao Chen | Tianyu Shi | Pengran Huang | Zeyuan Li | Jiahui Pan | Qianglong Chen | Lewei He
Findings of the Association for Computational Linguistics: EMNLP 2025
Generating logically coherent video from text (T2V) for reasoning-intensive tasks like mathematical problem-solving presents a significant challenge for Vision-Language Models (VLMs). Therefore, we introduce VisualEDU, a benchmark based on Manim package to rigorously evaluate VLM capabilities in producing coherent, step-by-step video solutions for educational purposes, with a framework that integrates meta-prompt learning, visual and code feedback, and a modular drawing toolkit to enhance output quality. Novel metrics for temporal consistency, logical correctness, and visual clarity are proposed, and extensive experiments across nine VLMs reveal that while advanced proprietary models show promise, all struggle significantly with increasing task complexity (e.g., the performances of Claude-3.7-Sonnet and GPT-4o are below 56% on difficult tasks ), highlighting limitations in code generation, visual feedback correction and precise tool invocation. VisualEDU offers a robust platform for systematic T2V assessment in reasoning-intensive domains and guides future VLM improvements in this area.
2024
RoleCraft-GLM: Advancing Personalized Role-Playing in Large Language Models
Meiling Tao | Liang Xuechen | Tianyu Shi | Lei Yu | Yiting Xie
Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024)
Meiling Tao | Liang Xuechen | Tianyu Shi | Lei Yu | Yiting Xie
Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024)
This study presents RoleCraft-GLM, an innovative framework aimed at enhancing personalized role-playing with Large Language Models (LLMs). RoleCraft-GLM addresses the key issue of lacking personalized interactions in conversational AI, and offers a solution with detailed and emotionally nuanced character portrayals. We contribute a unique conversational dataset that shifts from conventional celebrity-centric characters to diverse, non-celebrity personas, thus enhancing the realism and complexity of language modeling interactions. Additionally, our approach includes meticulous character development, ensuring dialogues are both realistic and emotionally resonant. The effectiveness of RoleCraft-GLM is validated through various case studies, highlighting its versatility and skill in different scenarios. Our framework excels in generating dialogues that accurately reflect characters’ personality traits and emotions, thereby boosting user engagement. In conclusion, RoleCraft-GLM marks a significant leap in personalized AI interactions, and paves the way for more authentic and immersive AI-assisted role-playing experiences by enabling more nuanced and emotionally rich dialogues.
Search
Fix author
Co-authors
- Lynn Ai 4
- Eric Yang 3
- Lewei He 2
- Lei Yu 2
- Meng Cao 1
- Xiao-Wen Chang 1
- Hao Chen 1
- Jiayu Chen 1
- Qianglong Chen 1
- Shuang Chen 1
- Wanyi Chen 1
- Zhangquan Chen 1
- Hang Ding 1
- Lei Ding 1
- Yiqun Duan 1
- Kaituo Feng 1
- ZhiYuan Feng 1
- Shixin Han 1
- Pengran Huang 1
- Wenxuan Huang 1
- Ziwei Ji 1
- Yang Jingsong 1
- Qizhen Lan 1
- Xiaoxuan Lei 1
- Zeyuan Li 1
- Peidong Liu 1
- Jiahui Pan 1
- Jingwei Song 1
- Jinwei Su 1
- Feiyue Tang 1
- Meiling Tao 1
- Hanbin Wang 1
- Junqiao Wang 1
- Ke Wang 1
- Wei Wang 1
- Xinyu Wang 1
- Zeyu Wang 1
- Hairu Wen 1
- Boyang Xia 1
- Yinghui Xia 1
- Xi Xiao 1
- Yicheng Xiao 1
- Yiting Xie 1
- Zequn Xie 1
- Liang Xuechen 1
- Pei Yang 1
- YU Yaqi 1
- Yimeng Ye 1
- Zhenyu Yu 1
- Chenyu Zeng 1
- Kaiming Zhang 1
- Manyuan Zhang 1
- QI Zhang 1
- Rongzhao Zhang 1
- Shuai Zhang 1
- Yucheng Zhou 1