Proceedings of the First Workshop of Evaluation of Multi-Modal Generation

Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor 2025-01 Association for Computational Linguistics Abu Dhabi, UAE text conference publication evalmg-ws-2025-1 https://aclanthology.org/2025.evalmg-1.0/ A Dataset for Programming-based Instructional Video Classification and Question Answering Sana Javaid Raja author Adeel Zafar author Aqsa Shoaib author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication raja-etal-2025-dataset https://aclanthology.org/2025.evalmg-1.1/ 2025-01 1 9 CVT5: Using Compressed Video Encoder and UMT5 for Dense Video Captioning Mohammad Javad Pirhadi author Motahhare Mirzaei author Sauleh Eetemadi author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication pirhadi-etal-2025-cvt5 https://aclanthology.org/2025.evalmg-1.2/ 2025-01 10 23 If I feel smart, I will do the right thing: Combining Complementary Multimodal Information in Visual Language Models Yuyu Bai author Sandro Pezzelle author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication bai-pezzelle-2025-feel https://aclanthology.org/2025.evalmg-1.3/ 2025-01 24 39 LLaVA-RE: Binary Image-Text Relevancy Evaluation with Multimodal Large Language Model Tao Sun author Oliver Liu author JinJin Li author Lan Ma author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication sun-etal-2025-llava https://aclanthology.org/2025.evalmg-1.4/ 2025-01 40 51 Persian in a Court: Benchmarking VLMs In Persian Multi-Modal Tasks Farhan Farsi author Shahriar Shariati Motlagh author Shayan Bali author Sadra Sabouri author Saeedeh Momtazi author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication farsi-etal-2025-persian https://aclanthology.org/2025.evalmg-1.5/ 2025-01 52 56 TaiwanVQA: A Benchmark for Visual Question Answering for Taiwanese Daily Life Hsin-Yi Hsieh author Shang Wei Liu author Chang Chih Meng author Shuo-Yueh Lin author Chen Chien-Hua author Hung-Ju Lin author Hen-Hsen Huang author I-Chen Wu author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication hsieh-etal-2025-taiwanvqa https://aclanthology.org/2025.evalmg-1.6/ 2025-01 57 75 Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types Neelabh Sinha author Vinija Jain author Aman Chadha author 2025-01 text Proceedings of the First Workshop of Evaluation of Multi-Modal Generation Wei Emma Zhang editor Xiang Dai editor Desmond Elliot editor Byron Fang editor Mongyuan Sim editor Haojie Zhuang editor Weitong Chen editor Association for Computational Linguistics Abu Dhabi, UAE conference publication sinha-etal-2025-guiding https://aclanthology.org/2025.evalmg-1.7/ 2025-01 76 94