A Pose-Based Pipeline for Annotation of Headshakes in Sign Language Corpora

Gustaf Gren, Nikolaus Riemer Kankkonen


Abstract
This paper introduces a pose-based pipeline designed to support scalable annotation of headshakes in sign language corpora. Motivated by the scarcity of annotated datasets and the need for quantitative typological research, the study evaluates whether automated detection can reduce human annotation effort. The system operates on yaw trajectories extracted with MediaPipe Holistic and uses sliding-window segmentation with neural sequence models (LSTM/CNN) to surface candidate segments for review. Training and evaluation are conducted on a subset of the German Sign Language (DGS) Corpus annotated to target grammatical headshakes functioning as negation rather than for every instance of headshakes. On the DGS dataset the best performing LSTM model achieves an F2-score of 0.45, recall of 0.63. Despite the narrow annotation scope, the pipeline reduces search space: annotators need review only 13% of frames to recover 87% of labeled instances. Error analysis indicates that many false positives correspond to plausible head movements excluded by the annotation criteria. A pilot transfer to Swedish Sign Language shows reduced effectiveness without adaptation, underscoring the need for alignment in cross-lingual transfer scenarios.
Anthology ID:
2026.signlang-1.21
Volume:
Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Johanna Mesch, Marc Schulder
Venues:
SignLang | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
193–202
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-signlang-21
DOI:
10.63317/4g5mwahb527o
Bibkey:
Cite (ACL):
Gustaf Gren and Nikolaus Riemer Kankkonen. 2026. A Pose-Based Pipeline for Annotation of Headshakes in Sign Language Corpora. In Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion, pages 193–202, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
A Pose-Based Pipeline for Annotation of Headshakes in Sign Language Corpora (Gren & Riemer Kankkonen, SignLang 2026)
Copy Citation: