Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes

Marcel Granero Moya, Carolina Del Corral Farrarós, Gloria Haro, Coloma Ballester, Ricardo Marques


Abstract
Sign language processing advances rapidly for high-resource languages such as American Sign Language (ASL), yet most of the world’s sign languages lack the phonological annotations new methods require. We present the first zero-shot cross-lingual framework for handshape recognition, transferring from ASL to Catalan Sign Language (LSC). Our approach leverages the decomposition of handshapes into five phonological features — selected fingers, flexion, spread, thumb position, and thumb contact — shared across both languages, to decode LSC handshapes from predicted features via a composite phonological distance metric. We evaluate three architectures (MLP, SL-GCN, SHuBERT) trained on two ASL corpora (PopSign, Sem-Lex) against a 37-handshape, single-signer LSC benchmark. Zero-shot transfer proves viable once recording-format disparities are harmonized, reaching 80.0% phonological feature accuracy and 54.5% expected handshape accuracy. Phonological decomposition thus offers a bridge for extending sign language technologies to low-resource languages without any target-language video training labels.
Anthology ID:
2026.wslp-1.18
Volume:
Proceedings of the Second Workshop on Sign Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sanjeet Singh, Abhinav Joshi, Pokala Dattatreya, Keren Artiaga, Khushi Jaydeep Pujara, Tomáš Železný, Ivan Gruber, Jakub Honzík, Sabyasachi Kamila, Facundo Manuel Quiroga, Marek Hrúz, Mohammed Hasanuzzaman, Ashutosh Modi
Venues:
WSLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
177–192
Language:
URL:
https://aclanthology.org/2026.wslp-1.18/
DOI:
Bibkey:
Cite (ACL):
Marcel Granero Moya, Carolina Del Corral Farrarós, Gloria Haro, Coloma Ballester, and Ricardo Marques. 2026. Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes. In Proceedings of the Second Workshop on Sign Language Processing, pages 177–192, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes (Granero Moya et al., WSLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wslp-1.18.pdf