Sanskrit Travelogue: A Large-Scale Unified and Annotated Corpus of Sanskrit Texts

Giacomo De Luca, Danilo Croce, Roberto Basili


Abstract
We present Sanskrit Travelogue, to our knowledge the largest open, unified and richly annotated Sanskrit corpus. Aggregating eight digital libraries, it comprises 12,394 texts, 73.1M tokens and 9M segments after de-duplication. A reproducible pipeline standardizes transliteration to IAST, reconciles heterogeneous metadata, preserves structural semantics (verse markers, chapter hierarchies, textual apparatus) and adds automatic annotations. We provide corpus-scale morphosyntactic annotation combining two systems: the BYT-5 Sanskrit model for compound and sandhi splitting, and the process-sanskrit library for inflection removal and morphological tagging through a hybrid deterministic-statistical cascade. For each segment we materialize synchronized representations: cleaned, analyzed (sandhi/compound split), stemmed, diacritic-normalized and morphologically tagged. These representations are indexed jointly for retrieval. Both approaches achieve high accuracy (84.61% sentence-level exact matches for BYT-5 segmentation, 92.37% correct root extraction for compounds, 95.94% on the Yoga Sūtra). Manual evaluation on the Yoga Sūtra showed 98% correct root extraction when combining both methods, outperforming individual approaches. These annotations enable searching across orthographic sandhi and within compounds, robust lemma-level retrieval despite rich inflectional variation, and provide training material for segmentation and lemmatization while maintaining ambiguity for downstream modeling. We release the annotated corpus as TSV shards, code for corpus acquisition, processing and annotation, a query normalizer, all under a Creative Commons non-commercial license.
Anthology ID:
2026.lrec-1.535
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
6722–6730
Language:
External URL:
https://lrec.elra.info/lrec2026-main-535
DOI:
10.63317/5ibfaw5j9br6
Bibkey:
Cite (ACL):
Giacomo De Luca, Danilo Croce, and Roberto Basili. 2026. Sanskrit Travelogue: A Large-Scale Unified and Annotated Corpus of Sanskrit Texts. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 6722–6730, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Sanskrit Travelogue: A Large-Scale Unified and Annotated Corpus of Sanskrit Texts (De Luca et al., LREC 2026)
Copy Citation: