Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment

Improving Conversational Abilities of Quantized Large Language Models via Direct Preference Alignment Janghwan Lee author Seongmin Park author Sukjin Hong author Minsoo Kim author Du-Seong Chang author Jungwook Choi author 2024-08 text Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication lee-etal-2024-improving-conversational 10.18653/v1/2024.acl-long.612 https://aclanthology.org/2024.acl-long.612/ 2024-08 11346 11364