IPA-Verified Singable Lyrics Translation with LLM Agents

Guan-Ming Chiu, Cheng Chiao-Chih, Kuan-Wei Lee


Abstract
Translating song lyrics while preserving singability requires satisfying musical constraints, including syllable counts, rhyme schemes, and syllable patterns, that standard machine translation ignores. We present a framework that exposes IPA-based phonetic analysis as a suite of composable Agent Skills, each defined by a natural-language description plus deterministic verification scripts that the orchestrating LLM invokes on demand. The agent extracts constraints from source lyrics, then translates through a multi-phase process, calling skills to verify syllable counts and rhyme and iteratively refine syllable-count mismatches. We formalize the three musical constraints, describe the IPA skill suite and agent architecture, and propose three evaluation metrics: Syllable Error Rate (SER), Syllable Count Relative Error (SCRE), and Adjusted Rand Index (ARI). Experiments across three frontier orchestrators, with component ablations, confirm that tool-verified translation dramatically improves constraint satisfaction and preserves rhyme structure substantially better than a supervised baseline, while requiring no task-specific training and no parallel corpora, and transferring to Spanish and Japanese targets with only a small language-specific syllabification adapter.
Anthology ID:
2026.findings-emnlp.1174
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24826–24841
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1174/
DOI:
10.18653/2026.findings-emnlp.1174
Bibkey:
Cite (ACL):
Guan-Ming Chiu, Cheng Chiao-Chih, and Kuan-Wei Lee. 2026. IPA-Verified Singable Lyrics Translation with LLM Agents. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 24826–24841, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
IPA-Verified Singable Lyrics Translation with LLM Agents (Chiu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1174.pdf