SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale

Zhaoyi An, Sihan Tan, Youngbae Hwang, Kazuhiro Nakadai, Rei Kawakami


Abstract
Sign language translation and generation share the goal of bidirectional alignment between text and sign representations. However, existing approaches either treat them as isolated tasks or are only verified on limited datasets, limiting effective modeling between modalities. In this paper, we propose SignFLIP, a unified LLM-centered framework for translation and generation. To enable bidirectional mapping between text and sign, SignFLIP adopts a symmetric architecture together with a stage-wise training strategy built on large-scale data. The shared sign–text representation is progressively refined: pre-alignment facilitates subsequent SLT, while the SLT-adapted representation further benefits SLG. Extensive experiments on multiple benchmarks show that SignFLIP shows competitive performance compared with task-specific models on both translation and generation tasks, as well as strong transferability to sign language recognition.
Anthology ID:
2026.findings-emnlp.828
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17562–17576
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.828/
DOI:
10.18653/2026.findings-emnlp.828
Bibkey:
Cite (ACL):
Zhaoyi An, Sihan Tan, Youngbae Hwang, Kazuhiro Nakadai, and Rei Kawakami. 2026. SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 17562–17576, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SignFLIP: A Unified Model for Sign Language Translation and Generation via Stage-wise Alignment at Scale (An et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.828.pdf