Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies

Adarsh Arigala, Arjun Gangwar, Srinivasan Umesh


Abstract
Recent alignment-free Text-to-Speech (TTS) models achieve high synthesis quality by removing explicit alignment modules and simplifying training. However, they often struggle in cross-lingual scenarios due to differences in character durations across languages, leading to duration mismatch and degraded speech quality. Existing approaches typically address this issue using explicit duration predictors, increasing model complexity. Systematic evaluation of TTS performance for Indian languages in cross-lingual settings remains under-explored due to the lack of standardized evaluation benchmarks. In this work, we construct a cross-lingual evaluation benchmark covering English and nine Indian languages and propose a language-aware inference-time duration estimation strategy for alignment-free TTS that incorporates language-specific duration-per character statistics without retraining or architectural modifications. We further develop heuristic formulations that refine duration estimation based on language-dependent duration variations. Experiments on bilingual and multilingual A-DMA models demonstrate improved speech naturalness, intelligibility, and speaker similarity while reducing duration mismatch.
Anthology ID:
2026.multilll-1.6
Volume:
Proceedings of the 1st Workshop on Multi-modality and Multi-lingual Language Learning
Month:
November
Year:
2026
Address:
Hengqin, Zhuhai, China
Editors:
Xiaoman Wang, Qianyu Wang, Zhengyuan Liu, Nancy F. Chen, Zheng Yuan, Yunshi Lan, Jing Jiang
Venues:
Multi-LLL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–55
Language:
URL:
https://aclanthology.org/2026.multilll-1.6/
DOI:
Bibkey:
Cite (ACL):
Adarsh Arigala, Arjun Gangwar, and Srinivasan Umesh. 2026. Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies. In Proceedings of the 1st Workshop on Multi-modality and Multi-lingual Language Learning, pages 47–55, Hengqin, Zhuhai, China. Association for Computational Linguistics.
Cite (Informal):
Cross-Lingual TTS for Indian Languages: A Benchmark and Inference-Time Duration Estimation Strategies (Arigala et al., Multi-LLL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.multilll-1.6.pdf