Marcel Granero Moya
Author directory2026
Zero-Shot Cross-Lingual Recognition of Sign Language Handshapes
Marcel Granero Moya | Carolina Del Corral Farrarós | Gloria Haro | Coloma Ballester | Ricardo Marques
Proceedings of the Second Workshop on Sign Language Processing
Marcel Granero Moya | Carolina Del Corral Farrarós | Gloria Haro | Coloma Ballester | Ricardo Marques
Proceedings of the Second Workshop on Sign Language Processing
Sign language processing advances rapidly for high-resource languages such as American Sign Language (ASL), yet most of the world’s sign languages lack the phonological annotations new methods require. We present the first zero-shot cross-lingual framework for handshape recognition, transferring from ASL to Catalan Sign Language (LSC). Our approach leverages the decomposition of handshapes into five phonological features — selected fingers, flexion, spread, thumb position, and thumb contact — shared across both languages, to decode LSC handshapes from predicted features via a composite phonological distance metric. We evaluate three architectures (MLP, SL-GCN, SHuBERT) trained on two ASL corpora (PopSign, Sem-Lex) against a 37-handshape, single-signer LSC benchmark. Zero-shot transfer proves viable once recording-format disparities are harmonized, reaching 80.0% phonological feature accuracy and 54.5% expected handshape accuracy. Phonological decomposition thus offers a bridge for extending sign language technologies to low-resource languages without any target-language video training labels.
2021
Taking Things Personally: Third Person to First Person Rephrasing
Marcel Granero Moya | Panagiotis Agis Oikonomou Filandras
Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI
Marcel Granero Moya | Panagiotis Agis Oikonomou Filandras
Proceedings of the 3rd Workshop on Natural Language Processing for Conversational AI
The recent advancement of digital assistant technologies has opened new possibilities in the experiences they can provide. One of them is the ability to converse with a persona, e.g. celebrities, famous imaginary characters, etc. This experience requires that the replies are answered from the point of view of the persona, i.e. the first person. Since the facts about characters are typically found expressed in the third person, there is a need to rephrase them to the first person in order for the assistant not to break character and the experience to remain immersive. However, the automatic solution to such a problem is largely unexplored by the community. In this work, we present a new task for NLP: third person to first person rephrasing. We define the task and analyze its major challenges. We create and publish a novel dataset with 3493 human-annotated pairs of celebrity facts in the third person with their rephrased sentence in the first person. Moreover, we propose a transformer-based pipeline that correctly rephrases 92.0% of sentences compared to 77.0% rephrased by a rule-based baseline system.