MRL Parsing Without Tears: The Case of Hebrew

Shaltiel Shmidman, Avi Shmidman, Moshe Koppel, Reut Tsarfaty


Abstract
Syntactic parsing remains a critical tool for relation extraction and information extraction, especially in resource-scarce languages where LLMs are lacking. Yet in morphologically rich languages (MRLs), where parsers need to identify multiple lexical units in each token, existing systems suffer in latency and setup complexity. Some use a pipeline to peel away the layers: first segmentation, then morphology tagging, and then syntax parsing; however, errors in earlier layers are then propagated forward. Others use a joint architecture to evaluate all permutations at once; while this improves accuracy, it is notoriously slow. In contrast, and taking Hebrew as a test case, we present a new “flipped pipeline”: decisions are made directly on the whole-token units by expert classifiers, each one dedicated to one specific task. The classifier predictions are independent of one another, and only at the end do we synthesize their predictions. This blazingly fast approach requires only a single huggingface call, without the need for recourse to lexicons or linguistic resources. When trained on the same training set used in previous studies, our model achieves near-SOTA performance on a wide array of Hebrew NLP tasks. Furthermore, when trained on a newly enlarged training corpus, our model achieves a new SOTA for Hebrew POS tagging and dependency parsing. We release this new SOTA model to the community. Because our architecture does not rely on any language-specific resources, it can serve as a model to develop similar parsers for other MRLs.
Anthology ID:
2024.findings-acl.269
Volume:
Findings of the Association for Computational Linguistics ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand and virtual meeting
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4537–4550
Language:
URL:
https://aclanthology.org/2024.findings-acl.269
DOI:
Bibkey:
Cite (ACL):
Shaltiel Shmidman, Avi Shmidman, Moshe Koppel, and Reut Tsarfaty. 2024. MRL Parsing Without Tears: The Case of Hebrew. In Findings of the Association for Computational Linguistics ACL 2024, pages 4537–4550, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics.
Cite (Informal):
MRL Parsing Without Tears: The Case of Hebrew (Shmidman et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.269.pdf