No, you’re not alone: A better way to find people with similar experiences on Reddit

Zhilin Wang, Elena Rastorgueva, Weizhe Lin, Xiaodong Wu


Abstract
We present a probabilistic clustering algorithm that can help Reddit users to find posts that discuss experiences similar to their own. This model is built upon the BERT Next Sentence Prediction model and reduces the time complexity for clustering all posts in a corpus from O(nˆ2) to O(n) with respect to the number of posts. We demonstrate that such probabilistic clustering can yield a performance better than baseline clustering methods based on Latent Dirichlet Allocation (Blei et al., 2003) and Word2Vec (Mikolov et al., 2013). Furthermore, there is a high degree of coherence between our probabilistic clustering and the exhaustive comparison O(nˆ2) algorithm in which the similarity between every pair of posts is found. This makes the use of the BERT Next Sentence Prediction model more practical for unsupervised clustering tasks due to the high runtime overhead of each BERT computation.
Anthology ID:
D19-5540
Volume:
Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019)
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Wei Xu, Alan Ritter, Tim Baldwin, Afshin Rahimi
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
307–315
Language:
URL:
https://aclanthology.org/D19-5540
DOI:
10.18653/v1/D19-5540
Bibkey:
Cite (ACL):
Zhilin Wang, Elena Rastorgueva, Weizhe Lin, and Xiaodong Wu. 2019. No, you’re not alone: A better way to find people with similar experiences on Reddit. In Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pages 307–315, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
No, you’re not alone: A better way to find people with similar experiences on Reddit (Wang et al., WNUT 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-5540.pdf