BIG-C: a Multimodal Multi-Purpose Dataset for Bemba

Claytone Sikasote, Eunice Mukonde, Md Mahfuz Ibn Alam, Antonios Anastasopoulos


Abstract
We present BIG-C (Bemba Image Grounded Conversations), a large multimodal dataset for Bemba. While Bemba is the most populous language of Zambia, it exhibits a dearth of resources which render the development of language technologies or language processing research almost impossible. The dataset is comprised of multi-turn dialogues between Bemba speakers based on images, transcribed and translated into English. There are more than 92,000 utterances/sentences, amounting to more than 180 hours of audio data with corresponding transcriptions and English translations. We also provide baselines on speech recognition (ASR), machine translation (MT) and speech translation (ST) tasks, and sketch out other potential future multimodal uses of our dataset. We hope that by making the dataset available to the research community, this work will foster research and encourage collaboration across the language, speech, and vision communities especially for languages outside the “traditionally” used high-resourced ones. All data and code are publicly available: [https://github.com/csikasote/bigc](https://github.com/csikasote/bigc).
Anthology ID:
2023.acl-long.115
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2062–2078
Language:
URL:
https://aclanthology.org/2023.acl-long.115
DOI:
10.18653/v1/2023.acl-long.115
Bibkey:
Cite (ACL):
Claytone Sikasote, Eunice Mukonde, Md Mahfuz Ibn Alam, and Antonios Anastasopoulos. 2023. BIG-C: a Multimodal Multi-Purpose Dataset for Bemba. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2062–2078, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
BIG-C: a Multimodal Multi-Purpose Dataset for Bemba (Sikasote et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.115.pdf
Video:
 https://aclanthology.org/2023.acl-long.115.mp4