A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques

A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques Megh Thakkar author Quentin Fournier author Matthew Riemer author Pin-Yu Chen author Amal Zouaq author Payel Das author Sarath Chandar author 2024-08 text Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication thakkar-etal-2024-deep 10.18653/v1/2024.acl-long.311 https://aclanthology.org/2024.acl-long.311/ 2024-08 5732 5745