Dual-Prompt-Driven Textual Knowledge Graph Generation With Heterogeneous Information Embedding for CTR Prediction

Xiling Feng, Han Liu, Yinghui Pan, Zhiwu Xu


Abstract
In click-through rate prediction tasks, learning high-quality feature embeddings from multi-field categorical data is an essential task. Early approaches typically need to transform categorical features into one-hot encoded vectors for producing embeddings. This transformation often results in loss of semantic information. In the era of large language models, it has become necessary to transform multi-field categorical data into text to achieve embedding of semantic information. Moreover, semantic information of each categorical feature can be useful to model the relationships among categories for enhancing the embedding quality. To address this point, in this paper, we propose an approach of dual-prompt-driven textual knowledge graph generation with heterogeneous information embedding for enhancing the representation of multi-field categorical data. Specifically, we design two prompt templates to transform multi-field categorical data into a textual knowledge graph for problem reformulation, and propose a heterogeneous information embedding approach that works by jointly representing the generated text and knowledge graph in the setting of cross-attention gated modality fusion with feature alignment. The experimental results indicate that our approach outperforms those baselines of click-through rate prediction. The results also indicate that each module of our approach is useful for improving the performance.
Anthology ID:
2026.emnlp-main.401
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9213–9230
Language:
URL:
https://aclanthology.org/2026.emnlp-main.401/
DOI:
Bibkey:
Cite (ACL):
Xiling Feng, Han Liu, Yinghui Pan, and Zhiwu Xu. 2026. Dual-Prompt-Driven Textual Knowledge Graph Generation With Heterogeneous Information Embedding for CTR Prediction. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 9213–9230, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Dual-Prompt-Driven Textual Knowledge Graph Generation With Heterogeneous Information Embedding for CTR Prediction (Feng et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.401.pdf