BASS: Batched Attention-optimized Speculative Sampling Haifeng Qian author Sujan Kumar Gonugondla author Sungsoo Ha author Mingyue Shang author Sanjay Krishna Gouda author Ramesh Nallapati author Sudipta Sengupta author Xiaofei Ma author Anoop Deoras author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication qian-etal-2024-bass 10.18653/v1/2024.findings-acl.489 https://aclanthology.org/2024.findings-acl.489/ 2024-08 8214 8224