Mengyue Wang
Author directory2026
DeepLook: Uncertainty-Guided Branching with Lookahead Confidence for Efficient Reasoning
Tingxin Yang | Zefeng Wang | Mengyue Wang | Jinhe Bi | Xingcheng Zhou | Volker Tresp | Yunpu Ma
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Tingxin Yang | Zefeng Wang | Mengyue Wang | Jinhe Bi | Xingcheng Zhou | Volker Tresp | Yunpu Ma
The Proceedings of the Third Workshop on Uncertainty-Aware NLP
Test-time scaling improves large language model reasoning, but spends compute uniformly along a reasoning trace, even in stretches that are already stable. Motivated by the observation that reasoning failures show an early onset of uncertainty, we introduce DeepLook, a training-free decoding framework that monitors segment-level confidence, branches only at uncertainty bottlenecks, and ranks candidate continuations by Average Lookahead Confidence (ALC)—their mean confidence over fixed-horizon rollouts—before completing and voting over a pruned subset. On four competition mathematics benchmarks across four open models, DeepLook matches or exceeds the accuracy of DeepConf-low in 12 of 16 settings while generating 87.3% fewer tokens, showing that a model’s own confidence is informative enough to decide where extra decoding compute is worth spending. On knowledge-intensive GPQA-Diamond the accuracy advantage disappears even though the token saving does not: coherent hallucinations also receive high ALC, so internal confidence localizes instability, not falsehood. Code will be released upon acceptance.
2025
METok: Multi-Stage Event-based Token Compression for Efficient Long Video Understanding
Mengyue Wang | Shuo Chen | Kristian Kersting | Volker Tresp | Yunpu Ma
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Mengyue Wang | Shuo Chen | Kristian Kersting | Volker Tresp | Yunpu Ma
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Recent advances in Video Large Language Models (VLLMs) have significantly enhanced their ability to understand video content. Nonetheless, processing long videos remains challenging due to high computational demands and the redundancy present in the visual data. In this work, we propose METok, a training-free, Multi-stage Event-based Token compression framework designed to accelerate VLLMs’ inference while preserving accuracy. METok progressively eliminates redundant visual tokens across three critical stages: (1) event-aware compression during vision encoding, (2) hierarchical token pruning in the prefilling stage based on semantic alignment and event importance, and (3) a decoding-stage KV Cache optimization that further reduces memory consumption. Our experiments on diverse video benchmarks demonstrate that METok achieves an optimal trade-off between efficiency and accuracy by dynamically selecting informative visual tokens. For instance, equipping LongVA-7B with METok realizes an 80.6% FLOPs reduction and 93.5% KV Cache memory savings, all while maintaining comparable or even superior accuracy.