Geolocation with Attention-Based Multitask Learning Models

Tommaso Fornaciari, Dirk Hovy


Abstract
Geolocation, predicting the location of a post based on text and other information, has a huge potential for several social media applications. Typically, the problem is modeled as either multi-class classification or regression. In the first case, the classes are geographic areas previously identified; in the second, the models directly predict geographic coordinates. The former requires discretization of the coordinates, but yields better performance. The latter is potentially more precise and true to the nature of the problem, but often results in worse performance. We propose to combine the two approaches in an attentionbased multitask convolutional neural network that jointly predicts both discrete locations and continuous geographic coordinates. We evaluate the multi-task (MTL) model against singletask models and prior work. We find that MTL significantly improves performance, reporting large gains on one data set, but also note that the correlation between labels and coordinates has a marked impact on the effectiveness of including a regression task.
Anthology ID:
D19-5528
Volume:
Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019)
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Wei Xu, Alan Ritter, Tim Baldwin, Afshin Rahimi
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
217–223
Language:
URL:
https://aclanthology.org/D19-5528
DOI:
10.18653/v1/D19-5528
Bibkey:
Cite (ACL):
Tommaso Fornaciari and Dirk Hovy. 2019. Geolocation with Attention-Based Multitask Learning Models. In Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pages 217–223, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Geolocation with Attention-Based Multitask Learning Models (Fornaciari & Hovy, WNUT 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-5528.pdf