Title It Right: Faithful and Attractive Paper Title Generation via Pareto Dominance Alignment

Ke Xiang, Yingchao Piao, Zexin Wang, Yufei Hou, Jianhui li, Jingjing LI, Zihan Liu, Hang Cui, Changhua Pei


Abstract
Generating academic paper titles requires balancing two key goals: faithfulness to the content and attractiveness to readers. Existing methods often treat title generation as a simple summarization task, producing accurate but unengaging titles. While multi-objective Direct Preference Optimization (DPO) offers a potential solution, our empirical analysis shows that combining conflicting objectives into a single reward is associated with substantial gradient interference during training. To address this problem, drawing inspiration from Pareto dominance in multi-objective optimization, we propose Multi-Objective Dominance Alignment (MODA), a data-centric training strategy tailored for academic title generation. MODA retains preference pairs with strict Pareto dominance, thereby reducing exposure to supervision with opposing reward directions. We implement MODA using dual reward models to independently score both dimensions. Across our experiments, this filtering strategy improves the observed balance between faithfulness and attractiveness, outperforms Human Author baselines, and approaches the performance of frontier models despite using an 8B backbone. Our code is publicly available at https://github.com/realyoume/title_it_right.
Anthology ID:
2026.findings-emnlp.829
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17577–17595
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.829/
DOI:
Bibkey:
Cite (ACL):
Ke Xiang, Yingchao Piao, Zexin Wang, Yufei Hou, Jianhui li, Jingjing LI, Zihan Liu, Hang Cui, and Changhua Pei. 2026. Title It Right: Faithful and Attractive Paper Title Generation via Pareto Dominance Alignment. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 17577–17595, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Title It Right: Faithful and Attractive Paper Title Generation via Pareto Dominance Alignment (Xiang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.829.pdf