Medieval Social Media: Manual and Automatic Annotation of Byzantine Greek Marginal Writing

Colin Swaelens, Ilse De Vos, Els Lefever


Abstract
In this paper, we present the interim results of a transformer-based annotation pipeline for Ancient and Medieval Greek. As the texts in the Database of Byzantine Book Epigrams have not been normalised, they pose more challenges for manual and automatic annotation than Ancient Greek, normalised texts do. As a result, the existing annotation tools perform poorly. We compiled three data sets for the development of an automatic annotation tool and carried out an inter-annotator agreement study, with a promising agreement score. The experimental results show that our part-of-speech tagger yields accuracy scores that are almost 50 percentage points higher than the widely used rule-based system Morpheus. In addition, error analysis revealed problems related to phenomena also occurring in current social media language.
Anthology ID:
2023.law-1.1
Volume:
Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Jakob Prange, Annemarie Friedrich
Venue:
LAW
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–9
Language:
URL:
https://aclanthology.org/2023.law-1.1
DOI:
10.18653/v1/2023.law-1.1
Bibkey:
Cite (ACL):
Colin Swaelens, Ilse De Vos, and Els Lefever. 2023. Medieval Social Media: Manual and Automatic Annotation of Byzantine Greek Marginal Writing. In Proceedings of the 17th Linguistic Annotation Workshop (LAW-XVII), pages 1–9, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Medieval Social Media: Manual and Automatic Annotation of Byzantine Greek Marginal Writing (Swaelens et al., LAW 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.law-1.1.pdf