Suggestion Miner at SemEval-2019 Task 9: Suggestion Detection in Online Forum using Word Graph

Usman Ahmed, Humera Liaquat, Luqman Ahmed, Syed Jawad Hussain


Abstract
This paper describes the suggestion miner system that participates in SemEval 2019 Task 9 - SubTask A - Suggestion Mining from Online Reviews and Forums. The system participated in the subtasks A. This paper discusses the results of our system in the development, evaluation and post evaluation. Each class in the dataset is represented as directed unweighted graphs. Then, the comparison is carried out with each class graph which results in a vector. This vector is used as features by a machine learning algorithm. The model is evaluated on hold on strategy. The organizers randomly split (8500 instances) training set (provided to the participant in training their system) and testing set (833 instances). The test set is reserved to evaluate the performance of participants systems. During the evaluation, our system ranked 31 in the Coda Lab result of the subtask A (binary class problem). The binary class system achieves evaluation value 0.34, precision 0.87, recall 0.73 and F measure 0.78.
Anthology ID:
S19-2218
Volume:
Proceedings of the 13th International Workshop on Semantic Evaluation
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota, USA
Editors:
Jonathan May, Ekaterina Shutova, Aurelie Herbelot, Xiaodan Zhu, Marianna Apidianaki, Saif M. Mohammad
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1242–1246
Language:
URL:
https://aclanthology.org/S19-2218
DOI:
10.18653/v1/S19-2218
Bibkey:
Cite (ACL):
Usman Ahmed, Humera Liaquat, Luqman Ahmed, and Syed Jawad Hussain. 2019. Suggestion Miner at SemEval-2019 Task 9: Suggestion Detection in Online Forum using Word Graph. In Proceedings of the 13th International Workshop on Semantic Evaluation, pages 1242–1246, Minneapolis, Minnesota, USA. Association for Computational Linguistics.
Cite (Informal):
Suggestion Miner at SemEval-2019 Task 9: Suggestion Detection in Online Forum using Word Graph (Ahmed et al., SemEval 2019)
Copy Citation:
PDF:
https://aclanthology.org/S19-2218.pdf