Multi-perspective Preference Alignment of LLMs for Programming-Community Question Answering

Hongyu Yang, Jiahui Hou, Liyang He, Rui Li


Abstract
Programming-Community Question Answering (PCQA) aims to tackle issues through generating functional code and guiding descriptions. It involves multiple candidates, with different users having varying preferences for them. Additionally, one may contain outdated APIs. These undoubtedly present a challenge for responsing that meet user preferences. Recently, Reinforcement Learning from Human Feedback demonstrates its ability to precisely control the behavior of large language models (LLMs) to yield human-like responses. However, applying it to LLMs in domain-specific PCQA remains unexplored. In this work, we propose Multi-perspective Preference Alignment for Programming-Community Question Answering to generate user-centric responses, called MupPCQA. It includes three stages: Preference Standardization to control content quality, Preference Integration to consider diverse user tendencies, Preference Timeliness Mitigation to alleviate outdated answers. Extensive experiments on a high-quality, real-world PCQA dataset validate its accuracy and preference. Compared to its base model, MupPCQA shows an improvement of nearly 11% in BLEU, with increases of 20% and 17.5% in BERTScore and CodeBERTScore.
Anthology ID:
2025.coling-main.113
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1667–1682
Language:
URL:
https://aclanthology.org/2025.coling-main.113/
DOI:
Bibkey:
Cite (ACL):
Hongyu Yang, Jiahui Hou, Liyang He, and Rui Li. 2025. Multi-perspective Preference Alignment of LLMs for Programming-Community Question Answering. In Proceedings of the 31st International Conference on Computational Linguistics, pages 1667–1682, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Multi-perspective Preference Alignment of LLMs for Programming-Community Question Answering (Yang et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.113.pdf