Processing Kinematics of Nonmanual Markers in R

Jan Bulla, Vadim Kimmelman


Abstract
Nonmanual markers, such as head and eyebrow movements, eye blinks, and mouth shapes, are an important part of natural languages, both spoken and signed. Recent developments in computer vision have made it possible to extract facial and body landmark positions, as well as head-rotation measures, from 2D video recordings, which can be further processed to analyse the kinematics of nonmanual articulators. In this paper, we present an R-based workflow for processing raw outputs of computer vision toolkits with the goal of producing reliable and interpretable kinematic measurements of nonmanual articulators.
Anthology ID:
2026.signlang-1.7
Volume:
Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Johanna Mesch, Marc Schulder
Venues:
SignLang | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
61–70
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-signlang-07
DOI:
10.63317/35fyd7w2c7sm
Bibkey:
Cite (ACL):
Jan Bulla and Vadim Kimmelman. 2026. Processing Kinematics of Nonmanual Markers in R. In Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion, pages 61–70, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Processing Kinematics of Nonmanual Markers in R (Bulla & Kimmelman, SignLang 2026)
Copy Citation: