Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR)

Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor 2021-06 Association for Computational Linguistics Groningen, Netherlands (Online) text conference publication mmsr-2021-multimodal https://aclanthology.org/2021.mmsr-1.0/ What is Multimodality? Letitia Parcalabescu author Nils Trost author Anette Frank author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication parcalabescu-etal-2021-multimodality https://aclanthology.org/2021.mmsr-1.1/ 2021-06 1 10 Are Gestures Worth a Thousand Words? An Analysis of Interviews in the Political Domain Daniela Trotta author Sara Tonelli author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication trotta-tonelli-2021-gestures https://aclanthology.org/2021.mmsr-1.2/ 2021-06 11 20 Requesting clarifications with speech and gestures Jonathan Ginzburg author Andy Luecking author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication ginzburg-luecking-2021-requesting https://aclanthology.org/2021.mmsr-1.3/ 2021-06 21 31 Seeing past words: Testing the cross-modal capabilities of pretrained V&L models on counting tasks Letitia Parcalabescu author Albert Gatt author Anette Frank author Iacer Calixto author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication parcalabescu-etal-2021-seeing https://aclanthology.org/2021.mmsr-1.4/ 2021-06 32 44 How Vision Affects Language: Comparing Masked Self-Attention in Uni-Modal and Multi-Modal Transformer Nikolai Ilinykh author Simon Dobnik author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication ilinykh-dobnik-2021-vision https://aclanthology.org/2021.mmsr-1.5/ 2021-06 45 55 EMISSOR: A platform for capturing multimodal interactions as Episodic Memories and Interpretations with Situated Scenario-based Ontological References Selene Baez Santamaria author Thomas Baier author Taewoon Kim author Lea Krause author Jaap Kruijt author Piek Vossen author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication baez-santamaria-etal-2021-emissor https://aclanthology.org/2021.mmsr-1.6/ 2021-06 56 77 Annotating anaphoric phenomena in situated dialogue Sharid Loáiciga author Simon Dobnik author David Schlangen author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication loaiciga-etal-2021-annotating https://aclanthology.org/2021.mmsr-1.7/ 2021-06 78 88 Incremental Unit Networks for Multimodal, Fine-grained Information State Representation Casey Kennington author David Schlangen author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication kennington-schlangen-2021-incremental https://aclanthology.org/2021.mmsr-1.8/ 2021-06 89 94 Teaching Arm and Head Gestures to a Humanoid Robot through Interactive Demonstration and Spoken Instruction Michael Brady author Han Du author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication brady-du-2021-teaching https://aclanthology.org/2021.mmsr-1.9/ 2021-06 95 101 Building a Video-and-Language Dataset with Human Actions for Multimodal Logical Inference Riko Suzuki author Hitomi Yanaka author Koji Mineshima author Daisuke Bekki author 2021-06 text Proceedings of the 1st Workshop on Multimodal Semantic Representations (MMSR) Lucia Donatelli editor Nikhil Krishnaswamy editor Kenneth Lai editor James Pustejovsky editor Association for Computational Linguistics Groningen, Netherlands (Online) conference publication suzuki-etal-2021-building https://aclanthology.org/2021.mmsr-1.10/ 2021-06 102 107