Neural Topic Modeling via Contextual and Graph Information Fusion

Jiyuan Liu, Jiaxing Yan, Chunjiang Zhu, Xingyu Liu, Li Qing, Yanghui Rao


Abstract
Topic modeling is a powerful unsupervised tool for knowledge discovery. However, existing work struggles with generating limited-quality topics that are uninformative and incoherent, which hindering interpretable insights from managing textual data. In this paper, we improve the original variational autoencoder framework by incorporating contextual and graph information to address the above issues. First, the encoder utilizes topic fusion techniques to combine contextual and bag-of-words information well, and meanwhile exploits the constraints of topic alignment and topic sharpening to generate informative topics. Second, we develop a simple word co-occurrence graph information fusion strategy that efficiently increases topic coherence. On three benchmark datasets, our new framework generates more coherent and diverse topics compared to various baselines, and achieves strong performance on both automatic and manual evaluations.
Anthology ID:
2025.emnlp-main.670
Volume:
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13258–13274
Language:
URL:
https://aclanthology.org/2025.emnlp-main.670/
DOI:
Bibkey:
Cite (ACL):
Jiyuan Liu, Jiaxing Yan, Chunjiang Zhu, Xingyu Liu, Li Qing, and Yanghui Rao. 2025. Neural Topic Modeling via Contextual and Graph Information Fusion. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 13258–13274, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Neural Topic Modeling via Contextual and Graph Information Fusion (Liu et al., EMNLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.emnlp-main.670.pdf
Checklist:
 2025.emnlp-main.670.checklist.pdf