Xiling Feng
Author directory2026
Dual-Prompt-Driven Textual Knowledge Graph Generation With Heterogeneous Information Embedding for CTR Prediction
Xiling Feng | Han Liu | Yinghui Pan | Zhiwu Xu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xiling Feng | Han Liu | Yinghui Pan | Zhiwu Xu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
In click-through rate prediction tasks, learning high-quality feature embeddings from multi-field categorical data is an essential task. Early approaches typically need to transform categorical features into one-hot encoded vectors for producing embeddings. This transformation often results in loss of semantic information. In the era of large language models, it has become necessary to transform multi-field categorical data into text to achieve embedding of semantic information. Moreover, semantic information of each categorical feature can be useful to model the relationships among categories for enhancing the embedding quality. To address this point, in this paper, we propose an approach of dual-prompt-driven textual knowledge graph generation with heterogeneous information embedding for enhancing the representation of multi-field categorical data. Specifically, we design two prompt templates to transform multi-field categorical data into a textual knowledge graph for problem reformulation, and propose a heterogeneous information embedding approach that works by jointly representing the generated text and knowledge graph in the setting of cross-attention gated modality fusion with feature alignment. The experimental results indicate that our approach outperforms those baselines of click-through rate prediction. The results also indicate that each module of our approach is useful for improving the performance.