Xiaofei Yue
Author directory2026
Semantic Retrieval Speculative Decoding with Intermediate Representations
Fangming Zhao | Xiaofei Yue | Fulun Ye | Yu Peng | Ziming Zhao | Lewei Jin | Wei Wu | Tianxiang Chen | Tingting Li | Jianwei Yin
Findings of the Association for Computational Linguistics: EMNLP 2026
Fangming Zhao | Xiaofei Yue | Fulun Ye | Yu Peng | Ziming Zhao | Lewei Jin | Wei Wu | Tianxiang Chen | Tingting Li | Jianwei Yin
Findings of the Association for Computational Linguistics: EMNLP 2026
Autoregressive decoding remains a key bottleneck for LLM inference, due to its token-by-token nature. Speculative decoding is proposed to reduce latency by drafting multiple tokens and verifying them with fewer target-model passes. However, existing methods either incur auxiliary-drafter overhead or rely on brittle lexical span reuse. In structured tasks (e.g., code generation and text editing), we observe significant locality of reference and semantic redundancy for potential semantic context reuse. In light of this, we present Semantic Retrieval Speculative Decoding (SRSD), a training-free scheme that treats intermediate-layer hidden states as an in-context semantic index. At each decoding step, SRSD retrieves semantically similar past positions. Multiple candidates are merged into a compact tree and verified jointly in a single forward pass. SRSD requires no auxiliary models or external datastores. Across a variety of popular LLMs, SRSD achieves up to 5.42× throughput speedups over state-of-the-art training-free methods and parametric drafters. The code is available at https://github.com/Secbrain/SRSD.
Explainable Quantum Program Repair with Verifiable Proof Traces
Tingting Li | Ziming Zhao | Zhaoxuan Li | Jiongchi Yu | Xiaofei Yue | Jianwei Yin
Findings of the Association for Computational Linguistics: ACL 2026
Tingting Li | Ziming Zhao | Zhaoxuan Li | Jiongchi Yu | Xiaofei Yue | Jianwei Yin
Findings of the Association for Computational Linguistics: ACL 2026
Large language models have recently advanced automated program repair, yet most existing approaches provide only post-hoc natural-language explanations that are neither executable nor verifiable. This limitation is especially critical for quantum programs, where correctness hinges on subtle semantic properties such as circuit equivalence and fidelity preservation. We propose Explainable Quantum Program Repair, a framework that couples repair generation with machine-checkable executable explanations. Given a buggy quantum circuit, a language model proposes candidate repairs together with structured transformation rationales, which are compiled into proof traces and validated using formal verification backends, including circuit equivalence checking, ZX-calculus reasoning, stabilizer analysis, and quantum simulation. Only repairs whose explanations are fully verified are accepted. Experiments on QASMBench with mutation-generated quantum program bugs demonstrate that our approach achieves competitive repair success while substantially improving semantic precision and explanation faithfulness over baselines that rely on unconstrained or purely natural-language explanations.
Efficient Learned Data Compression via Dual-Stream Feature Decoupling
Huidong Ma | Xinyan Shi | Sun Hui | Xiaofei Yue | Xiaoguang Liu | Gang Wang | Wentong Cai
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Huidong Ma | Xinyan Shi | Sun Hui | Xiaofei Yue | Xiaoguang Liu | Gang Wang | Wentong Cai
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
While Learned Data Compression (LDC) has achieved superior compression ratios, balancing precise probability modeling with system efficiency remains challenging. Crucially, uniform single-stream architectures struggle to simultaneously capture micro-syntactic and macro-semantic features, necessitating deep serial stacking that exacerbates latency. Compounding this, heterogeneous systems are constrained by device speed mismatches, where throughput is capped by Amdahl’s Law due to serial processing. To this end, we propose a Dual-Stream Multi-Scale Decoupler that disentangles local and global contexts to replace deep serial processing with shallow parallel streams, and incorporate a Hierarchical Gated Refiner for adaptive feature refinement and precise probability modeling. Furthermore, we design a Concurrent Stream-Parallel Pipeline, which overcomes systemic bottlenecks to achieve full-pipeline parallelism. Extensive experiments demonstrate that our method achieves state-of-the-art performance in both compression ratio and throughput, while maintaining the lowest latency and memory usage. The code is available at https://github.com/huidong-ma/FADE.