Ahmed E. Hassan
Author directory2026
Beyond Tokens: Semantic-Aware Speculative Decoding for Efficient Inference by Probing Internal States
Ximing Dong | Shaowei Wang | Dayi Lin | Boyuan Chen | Ahmed E. Hassan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ximing Dong | Shaowei Wang | Dayi Lin | Boyuan Chen | Ahmed E. Hassan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Language Models (LLMs) achieve strong performance across many tasks but suffer from high inference latency due to autoregressive decoding. The issue is exacerbated in Large Reasoning Models (LRMs), which generate lengthy chains of thought. While speculative decoding accelerates inference by drafting and verifying multiple tokens in parallel, existing methods operate at the token level and ignore semantic equivalence (i.e., different token sequences expressing the same meaning), leading to inefficient rejections. We propose SemanticSpec, a semantic-aware speculative decoding framework that verifies entire semantic sequences instead of tokens. SemanticSpec introduces a semantic probability estimation mechanism that probes the model’s internal hidden states to assess the likelihood of generating sequences with specific meanings. Experiments on four benchmarks show that SemanticSpec achieves up to 2.7× speedup on DeepSeekR1-32B and 2.1× on QwQ-32B, consistently outperforming token-level and sequence-level baselines in both efficiency and effectiveness.
LLM Post-Training as Brownfield Maintenance: An Industrial Perspective on Dataware Engineering
Gopi Krishnan Rajbahadur | Amir Ebrahimi | Boyuan Chen | Ahmed E. Hassan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Gopi Krishnan Rajbahadur | Amir Ebrahimi | Boyuan Chen | Ahmed E. Hassan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Industrial post-training is a brownfield regime. Teams inherit a deployed checkpoint and must land targeted improvements under fixed compute and mixture budgets without regressing the rest. The maintained artifact is increasingly **dataware**: behavior governed by a curated post-training mixture, updated via bounded mixture patches rather than clean-slate retraining. From an industrial code-generation improvement effort, we offer a maintainer’s perspective on why this work is hard in practice, distilling three recurring challenges, **zero-sum mixture design**, **yield as the binding metric**, and **end-to-end integration under uncertainty**, and arguing that progress depends less on one-off recipes than on an engineering discipline for programming dataware. In our case study, interventions that raised the conversion of teacher distillation into usable training data increased accepted supervision by **2.84×** while using the same solution teacher and four solution attempts per candidate problem. In our primary evaluation, the yield-engineered patch improved CodeForces pass@1 by **+2.59** points (+3.11 pass@3) and held-out LiveCodeBench v6 pass@1 by **+6.11** (+8.05 pass@3), all statistically significant across 16 stochastic evaluations of each benchmark from one fixed checkpoint per condition, with internal AIME and MATH regression suites within tolerance