Synthesis for the Kinematic Control of Identity in Sign Language

Félix Bigand, Elise Prigent, Annelies Braffort


Abstract
Sign Language (SL) animations generated from motion capture (mocap) of real signers convey critical information about their identity. It has been suggested that this information is mostly carried by statistics of the movements kinematics. Manipulating these statistics in the generation of SL movements could allow controlling the identity of the signer, notably to preserve anonymity. This paper tests this hypothesis by presenting a novel synthesis algorithm that manipulates the identity-specific statistics of mocap recordings. The algorithm produced convincing new versions of French Sign Language discourses, which accurately modulated the identity prediction of a machine learning model. These results open up promising perspectives toward the automatic control of identity in the motion animation of virtual signers.
Anthology ID:
2022.sltat-1.1
Volume:
Proceedings of the 7th International Workshop on Sign Language Translation and Avatar Technology: The Junction of the Visual and the Textual: Challenges and Perspectives
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, John C. McDonald, Dimitar Shterionov, Rosalee Wolfe
Venue:
SLTAT
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
1–6
Language:
URL:
https://aclanthology.org/2022.sltat-1.1
DOI:
Bibkey:
Cite (ACL):
Félix Bigand, Elise Prigent, and Annelies Braffort. 2022. Synthesis for the Kinematic Control of Identity in Sign Language. In Proceedings of the 7th International Workshop on Sign Language Translation and Avatar Technology: The Junction of the Visual and the Textual: Challenges and Perspectives, pages 1–6, Marseille, France. European Language Resources Association.
Cite (Informal):
Synthesis for the Kinematic Control of Identity in Sign Language (Bigand et al., SLTAT 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.sltat-1.1.pdf