Yinghui Pan

Author directory

2026

In click-through rate prediction tasks, learning high-quality feature embeddings from multi-field categorical data is an essential task. Early approaches typically need to transform categorical features into one-hot encoded vectors for producing embeddings. This transformation often results in loss of semantic information. In the era of large language models, it has become necessary to transform multi-field categorical data into text to achieve embedding of semantic information. Moreover, semantic information of each categorical feature can be useful to model the relationships among categories for enhancing the embedding quality. To address this point, in this paper, we propose an approach of dual-prompt-driven textual knowledge graph generation with heterogeneous information embedding for enhancing the representation of multi-field categorical data. Specifically, we design two prompt templates to transform multi-field categorical data into a textual knowledge graph for problem reformulation, and propose a heterogeneous information embedding approach that works by jointly representing the generated text and knowledge graph in the setting of cross-attention gated modality fusion with feature alignment. The experimental results indicate that our approach outperforms those baselines of click-through rate prediction. The results also indicate that each module of our approach is useful for improving the performance.