When Quantization Affects Confidence of Large Language Models?

When Quantization Affects Confidence of Large Language Models? Irina Proskurina author Luc Brun author Guillaume Metzler author Julien Velcin author 2024-06 text Findings of the Association for Computational Linguistics: NAACL 2024 Kevin Duh editor Helena Gomez editor Steven Bethard editor Association for Computational Linguistics Mexico City, Mexico conference publication proskurina-etal-2024-quantization 10.18653/v1/2024.findings-naacl.124 https://aclanthology.org/2024.findings-naacl.124/ 2024-06 1918 1928