François Lefebvre-Albaret
2012
Influence de la segmentation temporelle sur la caractérisation de signes (Influence of the temporal segmentation on the sign characterization) [in French]
François Lefebvre-Albaret
|
Jérémie Segouat
JEP-TALN-RECITAL 2012, Workshop DEGELS 2012: Défi GEste Langue des Signes (DEGELS 2012: Gestures and Sign Language Challenge)
2010
Video Retrieval in Sign Language Videos : How to Model and Compare Signs?
François Lefebvre-Albaret
|
Patrice Dalle
Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)
This paper deals with the problem of finding sign occurrences in a sign language (SL) video. It begins with an analysis of sign models and the way they can take into account the sign variability. Then, we review the most popular technics dedicated to automatic sign language processing and we focus on their adaptation to model sign variability. We present a new method to provide a parametric description of the sign as a set of continuous and discrete parameters. Signs are classified according to there categories (ballistic movements, circles ...), the symmetry between the hand movements, hand absolute and relative locations. Membership grades to sign categories and continuous parameter comparisons can be combined to estimate the similarity between two signs. We set out our system and we evaluate how much time can be saved when looking for a sign in a french sign language video. By now, our formalism only uses hand 2D locations, we finally discuss about the way of integrating other parameters as hand shape or facial expression in our framework.
Search