Guoqi Ma
2024
One2Set + Large Language Model: Best Partners for Keyphrase Generation
Liangying Shao
|
Liang Zhang
|
Minlong Peng
|
Guoqi Ma
|
Hao Yue
|
Mingming Sun
|
Jinsong Su
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Keyphrase generation (KPG) aims to automatically generate a collection of phrases representing the core concepts of a given document. The dominant paradigms in KPG include one2seq and one2set. Recently, there has been increasing interest in applying large language models (LLMs) to KPG. Our preliminary experiments reveal that it is challenging for a single model to excel in both recall and precision. Further analysis shows that: 1) the one2set paradigm owns the advantage of high recall, but suffers from improper assignments of supervision signals during training; 2) LLMs are powerful in keyphrase selection, but existing selection methods often make redundant selections. Given these observations, we introduce a generate-then-select framework decomposing KPG into two steps, where we adopt a one2set-based model as generator to produce candidates and then use an LLM as selector to select keyphrases from these candidates. Particularly, we make two important improvements on our generator and selector: 1) we design an Optimal Transport-based assignment strategy to address the above improper assignments; 2) we model the keyphrase selection as a sequence labeling task to alleviate redundant selections. Experimental results on multiple benchmark datasets show that our framework significantly surpasses state-of-the-art models, especially in absent keyphrase prediction.
Search
Co-authors
- Liangying Shao 1
- Liang Zhang 1
- Minlong Peng 1
- Hao Yue 1
- Mingming Sun 1
- show all...