Did Somebody Say ‘Gest-IT’? A Pilot Exploration of Multimodal Data Management

Ludovica Pannitto, Lorenzo Albanesi, Laura Marion, Federica Martines, Carmelo Caruso, Claudia Bianchini, Francesca Masini, Caterina Mauri


Abstract
The paper presents a pilot exploration of the construction, management and analysis of a multimodal corpus. Through athree-layer annotation that provides orthographic, prosodic, and gestural transcriptions, the gest-IT resource allows oneto investigate the variation of gesture-making patterns in conversations between sighted people and people with visualimpairment. After discussing the transcription methods and technical procedures employed in our study, we will propose aunified CoNLL-U corpus and indicate our future steps.
Anthology ID:
2024.clicit-1.80
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
735–745
Language:
URL:
https://aclanthology.org/2024.clicit-1.80/
DOI:
Bibkey:
Cite (ACL):
Ludovica Pannitto, Lorenzo Albanesi, Laura Marion, Federica Martines, Carmelo Caruso, Claudia Bianchini, Francesca Masini, and Caterina Mauri. 2024. Did Somebody Say ‘Gest-IT’? A Pilot Exploration of Multimodal Data Management. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 735–745, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
Did Somebody Say ‘Gest-IT’? A Pilot Exploration of Multimodal Data Management (Pannitto et al., CLiC-it 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.clicit-1.80.pdf