Integrating Syntactic and Discourse Signals through Multi-Encoder Fusion in NMT for Low-Resource Indian Language Pairs

Sobha Lalitha Devi, Vijay Sundar Ram, Pattabhi RK Rao


Abstract
Neural Machine Translation (NMT) for low-resource Indian language pairs such as Hindi–Tamil and Tamil–Malayalam remains challenging due to morphological richness, syntactic divergence, and limited availability of high-quality parallel corpora. While Transformer-based architectures achieve strong performance in high-resource settings, they often struggle to model syntactic structure and discourse-level dependencies in low-resource scenarios, resulting in errors in agreement, word order, and pronoun translation. In this work, we propose a linguistically informed multi-encoder fusion framework that explicitly incorporates syntactic and discourse signals into NMT. Experiments conducted on Hindi–Tamil and Tamil–Malayalam parallel corpora demonstrate consistent improvements over strong Transformer baselines in BLEU and ChrF scores, along with gains in pronoun translation accuracy and agreement consistency. The results highlight the effectiveness of explicit linguistic integration for improving NMT in low-resource Indian language settings.
Anthology ID:
2026.wildre-1.13
Volume:
Proceedings of the 8th Workshop on Indian Language Data: Resources and Evaluation
Month:
May
Year:
2026
Address:
Palma, Mallorca, Spain
Editors:
Girish Nath Jha, Kalika Bali, Sobha L, Devendr Kumar
Venues:
WILDRE | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
98–103
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-wildre-13
DOI:
10.63317/24vtvyv2iqhs
Bibkey:
Cite (ACL):
Sobha Lalitha Devi, Vijay Sundar Ram, and Pattabhi RK Rao. 2026. Integrating Syntactic and Discourse Signals through Multi-Encoder Fusion in NMT for Low-Resource Indian Language Pairs. In Proceedings of the 8th Workshop on Indian Language Data: Resources and Evaluation, pages 98–103, Palma, Mallorca, Spain. ELRA Language Resources Association (ELRA).
Cite (Informal):
Integrating Syntactic and Discourse Signals through Multi-Encoder Fusion in NMT for Low-Resource Indian Language Pairs (Lalitha Devi et al., WILDRE 2026)
Copy Citation: