An Element-wise Visual-enhanced BiLSTM-CRF Model for Location Name Recognition

Takuya Komada, Takashi Inui


Abstract
In recent years, previous studies have used visual information in named entity recognition (NER) for social media posts with attached images. However, these methods can only be applied to documents with attached images. In this paper, we propose a NER method that can use element-wise visual information for any documents by using image data corresponding to each word in the document. The proposed method obtains element-wise image data using an image retrieval engine, to be used as extra features in the neural NER model. Experimental results on the standard Japanese NER dataset show that the proposed method achieves a higher F1 value (89.67%) than a baseline method, demonstrating the effectiveness of using element-wise visual information.
Anthology ID:
2020.splu-1.1
Volume:
Proceedings of the Third International Workshop on Spatial Language Understanding
Month:
November
Year:
2020
Address:
Online
Editors:
Parisa Kordjamshidi, Archna Bhatia, Malihe Alikhani, Jason Baldridge, Mohit Bansal, Marie-Francine Moens
Venue:
SpLU
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–9
Language:
URL:
https://aclanthology.org/2020.splu-1.1
DOI:
10.18653/v1/2020.splu-1.1
Bibkey:
Cite (ACL):
Takuya Komada and Takashi Inui. 2020. An Element-wise Visual-enhanced BiLSTM-CRF Model for Location Name Recognition. In Proceedings of the Third International Workshop on Spatial Language Understanding, pages 1–9, Online. Association for Computational Linguistics.
Cite (Informal):
An Element-wise Visual-enhanced BiLSTM-CRF Model for Location Name Recognition (Komada & Inui, SpLU 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.splu-1.1.pdf
Video:
 https://slideslive.com/38940081