Hashtag Recommendation with Topical Attention-Based LSTM

Yang Li, Ting Liu, Jing Jiang, Liang Zhang


Abstract
Microblogging services allow users to create hashtags to categorize their posts. In recent years, the task of recommending hashtags for microblogs has been given increasing attention. However, most of existing methods depend on hand-crafted features. Motivated by the successful use of long short-term memory (LSTM) for many natural language processing tasks, in this paper, we adopt LSTM to learn the representation of a microblog post. Observing that hashtags indicate the primary topics of microblog posts, we propose a novel attention-based LSTM model which incorporates topic modeling into the LSTM architecture through an attention mechanism. We evaluate our model using a large real-world dataset. Experimental results show that our model significantly outperforms various competitive baseline methods. Furthermore, the incorporation of topical attention mechanism gives more than 7.4% improvement in F1 score compared with standard LSTM method.
Anthology ID:
C16-1284
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
3019–3029
Language:
URL:
https://aclanthology.org/C16-1284
DOI:
Bibkey:
Cite (ACL):
Yang Li, Ting Liu, Jing Jiang, and Liang Zhang. 2016. Hashtag Recommendation with Topical Attention-Based LSTM. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 3019–3029, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Hashtag Recommendation with Topical Attention-Based LSTM (Li et al., COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1284.pdf