Converting Multilayer Glosses into Semantic and Pragmatic forms with GENLIS

Rodolfo Delmonte, Serena Trolvi, Francesco Stiffoni


Abstract
This paper presents work carried out to transform glosses of a fable in Italian Sign Language (LIS) into a text which is then read by a TTS synthesizer from an SSML modified version of the same text. Whereas many systems exist that generate sign language from a text, we decided to do the reverse operation and generate text from LIS. For that purpose we used a version of the fable The Tortoise and the Hare, signed and made available on Youtube by ALBA cooperativa sociale, which was annotated manually by second author for her master’s thesis. In order to achieve our goal, we converted the multilayer glosses into linear Prolog terms to be fed to the generator. In the paper we focus on the main problems encountered in the transformation of the glosses into a semantically and pragmatically consistent representation. The main problems have been caused by the complexities of a text like a fable which requires coreference mechanisms and speech acts to be implemented in the representation which are often unexpressed and constitute implicit information.
Anthology ID:
2021.isa-1.6
Volume:
Proceedings of the 17th Joint ACL - ISO Workshop on Interoperable Semantic Annotation
Month:
June
Year:
2021
Address:
Groningen, The Netherlands (online)
Editor:
Harry Bunt
Venue:
ISA
SIG:
SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
54–64
Language:
URL:
https://aclanthology.org/2021.isa-1.6
DOI:
Bibkey:
Cite (ACL):
Rodolfo Delmonte, Serena Trolvi, and Francesco Stiffoni. 2021. Converting Multilayer Glosses into Semantic and Pragmatic forms with GENLIS. In Proceedings of the 17th Joint ACL - ISO Workshop on Interoperable Semantic Annotation, pages 54–64, Groningen, The Netherlands (online). Association for Computational Linguistics.
Cite (Informal):
Converting Multilayer Glosses into Semantic and Pragmatic forms with GENLIS (Delmonte et al., ISA 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.isa-1.6.pdf
Attachment:
 2021.isa-1.6.Attachment.zip