Capturing Methodology for Generating Synthetic and 3D Training Data in Catalan Sign Language (LSC): The Case of Verbal Agreement

Gemma Barberà, Inés Broto Clemente, Xavier Vinaixa Roselló, Roger Cassany Viladomat


Abstract
This paper proposes a hybrid methodology to generate high-quality synthetic data. Unlike other approaches based purely on generative Artificial Intelligence, which may suffer from hallucinations or inconsistent movements, this project uses 3D biomechanics and kinematics algorithms that enforce the anatomical constraints of the human body to ensure physically plausible movements. The aim of this research is to demonstrate that it is possible to synthetically expand the dataset. In particular, this paper focuses on verb agreement, a grammatical domain which is known for its morphological and articulatory complexity. By concentrating on the possible configurations of the movements in signing space when expressing different person agreeing verbal forms, we aim to capture real movements to extract physical parameters and apply them as logical rules —similar to those of a video game engine— to automatically synthesize thousands of new conjugations from infinitives with complete anatomical precision. Beyond spatial conjugation, the methodology further augments data through procedural variation of prosody and body morphology.
Anthology ID:
2026.signlang-1.1
Volume:
Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Eleni Efthimiou, Stavroula-Evita Fotinea, Thomas Hanke, Julie A. Hochgesang, Johanna Mesch, Marc Schulder
Venues:
SignLang | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
1–9
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-signlang-01
DOI:
10.63317/3g3si7nypow8
Bibkey:
Cite (ACL):
Gemma Barberà, Inés Broto Clemente, Xavier Vinaixa Roselló, and Roger Cassany Viladomat. 2026. Capturing Methodology for Generating Synthetic and 3D Training Data in Catalan Sign Language (LSC): The Case of Verbal Agreement. In Proceedings of the LREC 2026 12th Workshop on the Representation and Processing of Sign Languages: Language in Motion, pages 1–9, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Capturing Methodology for Generating Synthetic and 3D Training Data in Catalan Sign Language (LSC): The Case of Verbal Agreement (Barberà et al., SignLang 2026)
Copy Citation: