Query-OPT: Optimizing Inference of Large Language Models via Multi-Query Instructions in Meeting Summarization

Query-OPT: Optimizing Inference of Large Language Models via Multi-Query Instructions in Meeting Summarization Md Tahmid Rahman Laskar author Elena Khasanova author Xue-Yong Fu author Cheng Chen author Shashi Bhushan Tn author 2024-11 text Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track Franck Dernoncourt editor Daniel Preoţiuc-Pietro editor Anastasia Shimorina editor Association for Computational Linguistics Miami, Florida, US conference publication laskar-etal-2024-query 10.18653/v1/2024.emnlp-industry.86 https://aclanthology.org/2024.emnlp-industry.86/ 2024-11 1140 1151