Mihir Joshi
2019
Classification of Micro-Texts Using Sub-Word Embeddings
Mihir Joshi
|
Nur Zincir-Heywood
Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)
Extracting features and writing styles from short text messages is always a challenge. Short messages, like tweets, do not have enough data to perform statistical authorship attribution. Besides, the vocabulary used in these texts is sometimes improvised or misspelled. Therefore, in this paper, we propose combining four feature extraction techniques namely character n-grams, word n-grams, Flexible Patterns and a new sub-word embedding using the skip-gram model. Our system uses a Multi-Layer Perceptron to utilize these features from tweets to analyze short text messages. This proposed system achieves 85% accuracy, which is a considerable improvement over previous systems.
Search