Self-supervised context-aware COVID-19 document exploration through atlas grounding

Dusan Grujicic, Gorjan Radevski, Tinne Tuytelaars, Matthew Blaschko


Abstract
In this paper, we aim to develop a self-supervised grounding of Covid-related medical text based on the actual spatial relationships between the referred anatomical concepts. More specifically, we learn to project sentences into a physical space defined by a three-dimensional anatomical atlas, allowing for a visual approach to navigating Covid-related literature. We design a straightforward and empirically effective training objective to reduce the curated data dependency issue. We use BERT as the main building block of our model and perform a quantitative analysis that demonstrates that the model learns a context-aware mapping. We illustrate two potential use-cases for our approach, one in interactive, 3D data exploration, and the other in document retrieval. To accelerate research in this direction, we make public all trained models, codebase and the developed tools, which can be accessed at https://github.com/gorjanradevski/macchina/.
Anthology ID:
2020.nlpcovid19-acl.5
Volume:
Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020
Month:
July
Year:
2020
Address:
Online
Editors:
Karin Verspoor, Kevin Bretonnel Cohen, Mark Dredze, Emilio Ferrara, Jonathan May, Robert Munro, Cecile Paris, Byron Wallace
Venue:
NLP-COVID19
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
Language:
URL:
https://aclanthology.org/2020.nlpcovid19-acl.5
DOI:
Bibkey:
Cite (ACL):
Dusan Grujicic, Gorjan Radevski, Tinne Tuytelaars, and Matthew Blaschko. 2020. Self-supervised context-aware COVID-19 document exploration through atlas grounding. In Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020, Online. Association for Computational Linguistics.
Cite (Informal):
Self-supervised context-aware COVID-19 document exploration through atlas grounding (Grujicic et al., NLP-COVID19 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.nlpcovid19-acl.5.pdf
Code
 gorjanradevski/macchina