Soumik Dey
Author directory2026
Correctness Forensics for Batch Speculative Decoding: Diagnosing the Ragged Tensor Problem
Ranran Haoran Zhang | Soumik Dey | Ashirbad Mishra | Hansi Wu | Binbin Li | Rui Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Ranran Haoran Zhang | Soumik Dey | Ashirbad Mishra | Hansi Wu | Binbin Li | Rui Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Inference optimizations are routinely evaluated by throughput alone, without verifying output correctness. We conduct a forensic analysis of batch speculative decoding and find that several widely-used implementations silently produce corrupted outputs (repetitive tokens, <unk> symbols) while reporting competitive speed; failures invisible to metrics like ROUGE. We trace the root cause to the ragged tensor problem: variable token acceptance desynchronizes position IDs, attention masks, and KV-cache across a batch. We formalize the synchronization invariants (rectangular alignment and position-ID contiguity) that valid batched inference must preserve and show that maintaining them incurs superlinear alignment overhead under contiguous layouts. EQSPEC enforces the invariants without custom kernels; EXSPEC schedules same-length sequences to bypass realignment. On SpecBench across three model families, EXSPEC reaches 3 x throughput at batch size 8 with 95% exact match to standard decoding; residual divergence traces to floating-point non-determinism, not synchronization error.
2025
From Lazy to Prolific: Tackling Missing Labels in Open Vocabulary Extreme Classification by Positive-Unlabeled Sequence Learning
Ranran Haoran Zhang | Bensu Uçar | Soumik Dey | Hansi Wu | Binbin Li | Rui Zhang
Findings of the Association for Computational Linguistics: NAACL 2025
Ranran Haoran Zhang | Bensu Uçar | Soumik Dey | Hansi Wu | Binbin Li | Rui Zhang
Findings of the Association for Computational Linguistics: NAACL 2025
Performance and competence intertwined: A computational model of the Null Subject stage in English-speaking children
Soumik Dey | William Sakas
Proceedings of the Second International Workshop on Construction Grammars and NLP
Soumik Dey | William Sakas
Proceedings of the Second International Workshop on Construction Grammars and NLP
The empirically established null subject (NS) stage, lasting until about 4 years of age, involves frequent omission of subjects by children. Orfitelli and Hyams (2012) observe that young English speakers often confuse imperative NS utterances with declarative ones due to performance influences, promoting a temporary null subject grammar. We propose a new computational parameter to measure this misinterpretation and incorporate it into a simulated model of obligatory subject grammar learning. Using a modified version of the Variational Learner (Yang, 2012) which works for superset-subset languages, our simulations support Orfitelli and Hyams’ hypothesis. More generally, this study outlines a framework for integrating computational models in the study of grammatical acquisition alongside other key developmental factors.