Cognate Transformer for Automated Phonological Reconstruction and Cognate Reflex Prediction

V.S.D.S.Mahesh Akavarapu, Arnab Bhattacharya


Abstract
Phonological reconstruction is one of the central problems in historical linguistics where a proto-word of an ancestral language is determined from the observed cognate words of daughter languages. Computational approaches to historical linguistics attempt to automate the task by learning models on available linguistic data. Several ideas and techniques drawn from computational biology have been successfully applied in this area of computational historical linguistics. Following these lines, we adapt MSA Transformer, a protein language model, to the problem of automated phonological reconstruction. MSA Transformer trains on multiple sequence alignments as input and is, thus, apt for application on aligned cognate words. We, hence, name our model as Cognate Transformer. We also apply the model on another associated task, namely, cognate reflex prediction where a reflex word in a daughter language is predicted based on cognate words from other daughter languages. We show that our model outperforms the existing models on both the tasks, especially when it is pre-trained on masked word prediction task.
Anthology ID:
2023.emnlp-main.423
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6852–6862
Language:
URL:
https://aclanthology.org/2023.emnlp-main.423
DOI:
10.18653/v1/2023.emnlp-main.423
Bibkey:
Cite (ACL):
V.S.D.S.Mahesh Akavarapu and Arnab Bhattacharya. 2023. Cognate Transformer for Automated Phonological Reconstruction and Cognate Reflex Prediction. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 6852–6862, Singapore. Association for Computational Linguistics.
Cite (Informal):
Cognate Transformer for Automated Phonological Reconstruction and Cognate Reflex Prediction (Akavarapu & Bhattacharya, EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.423.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.423.mp4