SignGPT and the Visual Language Toolkit

Matt Brown, Oline Ranum, Edward Fish, Heidi Proctor, Bencie Woll, Richard Bowden, Kearsy Cormier


Abstract
SignGPT’s Visual Language Toolkit (VLTK) aims to remove fundamental barriers to large scale sign language modelling by developing data-driven, linguistically grounded methods for continuous sign language recognition. We first identify fundamental issues around the ecological validity of potential data sources (e.g. broadcast media with interpreted signing or captions, scraping of social media). We contrast these with the currently highly resource-intensive development of curated sign language corpora based on linguistic principles. The VLTK addresses this scarcity of high quality sign language data by providing semi-automated glossing and other recognition tools, driving large scale corpus expansion without sacrificing linguistic principles. Unlike prior systems that rely on sparse glossing, the project integrates dense temporal annotation, non-manual and non-lexical feature tracking, and transformer-based architectures to capture the multimodal and spatial structure of signing. By aligning machine vision innovation with linguistic insights and community-embedded evaluation, SignGPT establishes a foundation for robust and extensible sign language models.
Anthology ID:
2026.signlang-1.6
Volume:
Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Johanna Mesch, Marc Schulder
Venues:
SignLang | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
51–60
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-signlang-06
DOI:
10.63317/5ez54d2x8yos
Bibkey:
Cite (ACL):
Matt Brown, Oline Ranum, Edward Fish, Heidi Proctor, Bencie Woll, Richard Bowden, and Kearsy Cormier. 2026. SignGPT and the Visual Language Toolkit. In Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion, pages 51–60, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
SignGPT and the Visual Language Toolkit (Brown et al., SignLang 2026)
Copy Citation: