Autoencoding Keyword Correlation Graph for Document Clustering

Billy Chiu, Sunil Kumar Sahu, Derek Thomas, Neha Sengupta, Mohammady Mahdy


Abstract
Document clustering requires a deep understanding of the complex structure of long-text; in particular, the intra-sentential (local) and inter-sentential features (global). Existing representation learning models do not fully capture these features. To address this, we present a novel graph-based representation for document clustering that builds a graph autoencoder (GAE) on a Keyword Correlation Graph. The graph is constructed with topical keywords as nodes and multiple local and global features as edges. A GAE is employed to aggregate the two sets of features by learning a latent representation which can jointly reconstruct them. Clustering is then performed on the learned representations, using vector dimensions as features for inducing document classes. Extensive experiments on two datasets show that the features learned by our approach can achieve better clustering performance than other existing features, including term frequency-inverse document frequency and average embedding.
Anthology ID:
2020.acl-main.366
Volume:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2020
Address:
Online
Editors:
Dan Jurafsky, Joyce Chai, Natalie Schluter, Joel Tetreault
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3974–3981
Language:
URL:
https://aclanthology.org/2020.acl-main.366
DOI:
10.18653/v1/2020.acl-main.366
Bibkey:
Cite (ACL):
Billy Chiu, Sunil Kumar Sahu, Derek Thomas, Neha Sengupta, and Mohammady Mahdy. 2020. Autoencoding Keyword Correlation Graph for Document Clustering. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 3974–3981, Online. Association for Computational Linguistics.
Cite (Informal):
Autoencoding Keyword Correlation Graph for Document Clustering (Chiu et al., ACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.acl-main.366.pdf
Video:
 http://slideslive.com/38928850