From Lemmatization to Legal Terminology: Assessing an Hybrid Pipeline on Justinian’s Digest

Paola Marongiu, Eva Sassolini


Abstract
This paper evaluates a hybrid NLP pipeline for supporting the extraction of Roman legal terminology from Jus- tinian’s Digest. Our goal is not to optimize lemmatization in isolation, but to assess whether integrating a Large Language Model (GPT-4o-mini) as a post-processing component improves lemma quality in ways that are critical for downstream glossary construction. Using LatinPipe as a baseline (F1 = 95.05), we test the integration of GPT-4o-mini under three experimental settings (zero-shot with and without prior lemma information, and few-shot prompting) against a manually annotated gold standard of 3,703 sentences and an expert-validated list of legal Latin technical terms. Results show improvement across all settings, with the best performance achieved in the few-shot configuration. Our analysis shows that the hybrid configuration produces selective improvements, significantly more likely for frequent lemmas and verbs forms, suggesting that the LLM layer primarily assists in resolving morphologically ambiguous inflected forms. Although our experimental conditions may not hold in real-world scenarios, we argue that the main contribution of this work is methodological: demonstrating how evaluation can be aligned with downstream terminological goals, rather than proposing a general-purpose solution to domain-specific lemmatization.
Anthology ID:
2026.lt4hala-1.43
Volume:
Proceedings of the Fourth Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA 2026) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Rachele Sprugnoli, Marco Passarotti
Venues:
LT4HALA | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
418–428
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-lt4hala-43
DOI:
10.63317/4x2mcetz9f5r
Bibkey:
Cite (ACL):
Paola Marongiu and Eva Sassolini. 2026. From Lemmatization to Legal Terminology: Assessing an Hybrid Pipeline on Justinian’s Digest. In Proceedings of the Fourth Workshop on Language Technologies for Historical and Ancient Languages (LT4HALA 2026) @ LREC 2026, pages 418–428, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
From Lemmatization to Legal Terminology: Assessing an Hybrid Pipeline on Justinian’s Digest (Marongiu & Sassolini, LT4HALA 2026)
Copy Citation: