Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization Zhanhui Zhou author Jie Liu author Jing Shao author Xiangyu Yue author Chao Yang author Wanli Ouyang author Yu Qiao author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication zhou-etal-2024-beyond 10.18653/v1/2024.findings-acl.630 https://aclanthology.org/2024.findings-acl.630/ 2024-08 10586 10613