The Current Landscape of Multimodal Summarization

Kumbhar Atharva, Kulkarni Harsh, Mali Atmaja, Sonawane Sheetal, Mulay Prathamesh


Abstract
In recent years, the rise of multimedia content on the internet has inundated users with a vast and diverse array of information, including images, videos, and textual data. Handling this flood of multimedia data necessitates advanced techniques capable of distilling this wealth of information into concise, meaningful summaries. Multimodal summarization, which involves generating summaries from multiple modalities such as text, images, and videos, has become a pivotal area of research in natural language processing, computer vision, and multimedia analysis. This survey paper offers an overview of the state-of-the-art techniques, methodologies, and challenges in the domain of multimodal summarization. We highlight the interdisciplinary advancements made in this field specifically on the lines of two main frontiers:1) Multimodal Abstractive Summarization, and 2) Pre-training Language Models in Multimodal Summarization. By synthesizing insights from existing research, we aim to provide a holistic understanding of multimodal summarization techniques.
Anthology ID:
2023.icon-1.82
Volume:
Proceedings of the 20th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2023
Address:
Goa University, Goa, India
Editors:
D. Pawar Jyoti, Lalitha Devi Sobha
Venue:
ICON
SIG:
SIGLEX
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
797–806
Language:
URL:
https://aclanthology.org/2023.icon-1.82
DOI:
Bibkey:
Cite (ACL):
Kumbhar Atharva, Kulkarni Harsh, Mali Atmaja, Sonawane Sheetal, and Mulay Prathamesh. 2023. The Current Landscape of Multimodal Summarization. In Proceedings of the 20th International Conference on Natural Language Processing (ICON), pages 797–806, Goa University, Goa, India. NLP Association of India (NLPAI).
Cite (Informal):
The Current Landscape of Multimodal Summarization (Atharva et al., ICON 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.icon-1.82.pdf