Zijian Wen
Author directory2026
Rethinking Stepwise Model Routing: A Cost-Efficient Table Reasoning Perspective
Shenghao Ye | Yuxiang Wang | Yu Guo | Tao Zhang | Shuangwu Chen | Zijian Wen | Qihui Zhu | Mengjie Zhang | Dong Jin | Wang Luo | Jianyang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shenghao Ye | Yuxiang Wang | Yu Guo | Tao Zhang | Shuangwu Chen | Zijian Wen | Qihui Zhu | Mengjie Zhang | Dong Jin | Wang Luo | Jianyang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Reasoning Models (LRMs) achieve strong performance on table reasoning tasks but incur substantial inference cost due to long reasoning traces. Stepwise model routing mitigates this issue by dynamically assigning reasoning steps to smaller or larger models. However, stepwise model routing for table reasoning remains underexplored. Through empirical analysis, we find that reasoning steps involving tables contain two types of tokens with distinct uncertainty distributions: table tokens grounded in table structure, such as cell values and headers, and text tokens representing surrounding natural-language reasoning. The uncertainty of both token types is correlated with the risk that the model makes an error in the next reasoning step. However, existing methods fail to model them separately, leading to suboptimal routing decisions. To address this, we propose EcoTab, a table-aware stepwise routing framework for efficient table reasoning. For each current reasoning step, EcoTab separately models the two types of tokens and estimates their uncertainties, then combines them to estimate the risk of using the small model for the next step, thereby enabling model selection. Experiments on multiple table reasoning benchmarks show that EcoTab consistently outperforms strong baselines and achieves a better balance between accuracy and efficiency.
VISA: Video Skeleton-Aware Efficient Frame Selection for Long Video Understanding
Qihui Zhu | Zijian Wen | Tao Zhang | Mengjie Zhang | Shenghao Ye | Dong Jin | Shuangwu Chen | Xiaobin Tan | Quan Zheng | Jianyang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Qihui Zhu | Zijian Wen | Tao Zhang | Mengjie Zhang | Shenghao Ye | Dong Jin | Shuangwu Chen | Xiaobin Tan | Quan Zheng | Jianyang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-video understanding remains challenging for multimodal large language models (MLLMs), as informative visual evidence is often sparsely distributed across many redundant frames. Although sampling more frames can improve coverage, it also increases visual encoding overhead and consumes more visual tokens, making compact frame selection essential. However, existing methods often sample candidate frames uniformly before selection, which may require decoding most frames of the video. Moreover, simply selecting frames by query relevance may overlook the global temporal structure needed for coherent video understanding. To address these limitations, we propose VISA, a VIdeo Skeleton-Aware framework for efficient long-video frame selection. VISA exploits sparse I-frame anchors from the native GOP structure to avoid dense candidate decoding and constructs a video skeleton that preserves the coarse temporal progression. Query relevance is aggregated over this skeleton to select informative anchors, followed by cross-GOP refinement to obtain final frames. Extensive experiments show that VISA consistently improves long-video understanding, achieving up to 8.8% relative gain over uniform sampling. Meanwhile, VISA reduces average end-to-end latency by 32.9%–53.6% compared with recent frame selection baselines on LongVideoBench, demonstrating both effectiveness and efficiency for long-video frame selection.
SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving
Zijian Wen | Tao Zhang | Shuangwu Chen | Shenghao Ye | Yu Guo | Qirui Chen | Jingxian Shuai | Yunpeng Hou | Huasen He | Jianyang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zijian Wen | Tao Zhang | Shuangwu Chen | Shenghao Ye | Yu Guo | Qirui Chen | Jingxian Shuai | Yunpeng Hou | Huasen He | Jianyang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Retrieval-Augmented Generation (RAG) significantly enhances LLMs but faces high prefill latency during long-context processing. While KV cache reuse can mitigate this, current methods relying on shallow features or static heuristics often fail to identify critical tokens for recomputation, resulting in generation quality degradation.We have an insight that KV deviations are more pronounced in deep layers.However, directly extracting deep-layer features from the target model is computationally prohibitive. Crucially, we find that the deep-layer features of a lightweight speculative model exhibit strong consistency with the target model in the selection of critical tokens for recomputation.In light of these insights, we propose SpecCache, which employs deep-layer hidden-state norms from a speculative model as a proxy to guide the critical token selection for target large model.Experiments demonstrate that SpecCache outperforms state-of-the-art (SOTA) baselines. Compared to full KV recomputation, it reduces time-to-first-token (TTFT) by 2.17-3.95× and increases inference throughput by 2.7-5.2×, with negligible degradation in generation quality relative to full recomputation.
Rethinking Table Pruning in TableQA: From Sequential Revisions to Gold Trajectory-Supervised Parallel Search
Yu Guo | Shenghao Ye | Shuangwu Chen | Zijian Wen | Tao Zhang | Bai Qirui | Dong Jin | Yunpeng Hou | Huasen He | Jianyang | Xiaobin Tan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yu Guo | Shenghao Ye | Shuangwu Chen | Zijian Wen | Tao Zhang | Bai Qirui | Dong Jin | Yunpeng Hou | Huasen He | Jianyang | Xiaobin Tan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Table Question Answering (TableQA) benefits significantly from table pruning, which extracts compact sub-tables by eliminating redundant cells to streamline downstream reasoning. However, existing pruning methods typically rely on sequential revisions driven by unreliable critique signals, often failing to detect the loss of answer-critical data. To address this limitation, we propose TabTrim, a novel table pruning framework which transforms table pruning from sequential revisions to gold trajectory-supervised parallel search. TabTrim derives a gold pruning trajectory using the intermediate sub-tables in the execution process of gold SQL queries, and trains a pruner and a verifier to make the step-wise pruning result align with the gold pruning trajectory. During inference, TabTrim performs parallel search to explore multiple candidate pruning trajectories and identify the optimal sub-table. Extensive experiments demonstrate that TabTrim achieves state-of-the-art performance across diverse tabular reasoning tasks: TabTrim-8B reaches 73.5% average accuracy, outperforming the strongest baseline by 3.2%, including 79.4% on WikiTQ and 61.2% on TableBench.