Proceedings of the First Workshop on Scaling Up Multilingual Evaluation

Proceedings of the First Workshop on Scaling Up Multilingual Evaluation Kabir Ahuja editor Antonios Anastasopoulos editor Barun Patra editor Graham Neubig editor Monojit Choudhury editor Sandipan Dandapat editor Sunayana Sitaram editor Vishrav Chaudhary editor 2022-11 Association for Computational Linguistics Online text conference publication sumeval-2022-scaling 10.18653/v1/2022.sumeval-1.0 https://aclanthology.org/2022.sumeval-1.0/ The SUMEval 2022 Shared Task on Performance Prediction of Multilingual Pre-trained Language Models Kabir Ahuja author Antonios Anastasopoulos author Barun Patra author Graham Neubig author Monojit Choudhury author Sandipan Dandapat author Sunayana Sitaram author Vishrav Chaudhary author 2022-11 text Proceedings of the First Workshop on Scaling Up Multilingual Evaluation Kabir Ahuja editor Antonios Anastasopoulos editor Barun Patra editor Graham Neubig editor Monojit Choudhury editor Sandipan Dandapat editor Sunayana Sitaram editor Vishrav Chaudhary editor Association for Computational Linguistics Online conference publication ahuja-etal-2022-sumeval 10.18653/v1/2022.sumeval-1.1 https://aclanthology.org/2022.sumeval-1.1/ 2022-11 1 7 To Train or Not to Train: Predicting the Performance of Massively Multilingual Models Shantanu Patankar author Omkar Gokhale author Onkar Litake author Aditya Mandke author Dipali Kadam author 2022-11 text Proceedings of the First Workshop on Scaling Up Multilingual Evaluation Kabir Ahuja editor Antonios Anastasopoulos editor Barun Patra editor Graham Neubig editor Monojit Choudhury editor Sandipan Dandapat editor Sunayana Sitaram editor Vishrav Chaudhary editor Association for Computational Linguistics Online conference publication patankar-etal-2022-train 10.18653/v1/2022.sumeval-1.2 https://aclanthology.org/2022.sumeval-1.2/ 2022-11 8 12 The GMU System Submission for the SUMEval 2022 Shared Task Syeda Sabrina Akter author Antonios Anastasopoulos author 2022-11 text Proceedings of the First Workshop on Scaling Up Multilingual Evaluation Kabir Ahuja editor Antonios Anastasopoulos editor Barun Patra editor Graham Neubig editor Monojit Choudhury editor Sandipan Dandapat editor Sunayana Sitaram editor Vishrav Chaudhary editor Association for Computational Linguistics Online conference publication akter-anastasopoulos-2022-gmu 10.18653/v1/2022.sumeval-1.3 https://aclanthology.org/2022.sumeval-1.3/ 2022-11 13 20 NTREX-128 – News Test References for MT Evaluation of 128 Languages Christian Federmann author Tom Kocmi author Ying Xin author 2022-11 text Proceedings of the First Workshop on Scaling Up Multilingual Evaluation Kabir Ahuja editor Antonios Anastasopoulos editor Barun Patra editor Graham Neubig editor Monojit Choudhury editor Sandipan Dandapat editor Sunayana Sitaram editor Vishrav Chaudhary editor Association for Computational Linguistics Online conference publication federmann-etal-2022-ntrex 10.18653/v1/2022.sumeval-1.4 https://aclanthology.org/2022.sumeval-1.4/ 2022-11 21 24 IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages Muhammad Farid Adilazuarda author Samuel Cahyawijaya author Genta Indra Winata author Pascale Fung author Ayu Purwarianti author 2022-11 text Proceedings of the First Workshop on Scaling Up Multilingual Evaluation Kabir Ahuja editor Antonios Anastasopoulos editor Barun Patra editor Graham Neubig editor Monojit Choudhury editor Sandipan Dandapat editor Sunayana Sitaram editor Vishrav Chaudhary editor Association for Computational Linguistics Online conference publication adilazuarda-etal-2022-indorobusta 10.18653/v1/2022.sumeval-1.5 https://aclanthology.org/2022.sumeval-1.5/ 2022-11 25 34