Embodied Language Learning: Opportunities, Challenges, and Future Directions

Nadine Amin, Julia Rayz


Abstract
While large language and vision-language models showcase impressive capabilities, they face a notable limitation: the inability to connect language with the physical world. To bridge this gap, research has focused on embodied language learning, where the language learner is situated in the world, perceives it, and interacts with it. This article explores the current standing of research in embodied language learning, highlighting opportunities and discussing common challenges. Lastly, it identifies existing gaps from the perspective of language understanding research within the embodied world and suggests potential future directions.
Anthology ID:
2024.findings-acl.908
Volume:
Findings of the Association for Computational Linguistics ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand and virtual meeting
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
15369–15379
Language:
URL:
https://aclanthology.org/2024.findings-acl.908
DOI:
Bibkey:
Cite (ACL):
Nadine Amin and Julia Rayz. 2024. Embodied Language Learning: Opportunities, Challenges, and Future Directions. In Findings of the Association for Computational Linguistics ACL 2024, pages 15369–15379, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics.
Cite (Informal):
Embodied Language Learning: Opportunities, Challenges, and Future Directions (Amin & Rayz, Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.908.pdf