%0 Conference Proceedings %T Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future %E Church, Kenneth %E Liberman, Mark %E Kordoni, Valia %D 2021 %8 August %I Association for Computational Linguistics %C Online %F bppf-2021-benchmarking %U https://aclanthology.org/2021.bppf-1.0 %0 Conference Proceedings %T Benchmarking: Past, Present and Future %A Church, Kenneth %A Liberman, Mark %A Kordoni, Valia %Y Church, Kenneth %Y Liberman, Mark %Y Kordoni, Valia %S Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future %D 2021 %8 August %I Association for Computational Linguistics %C Online %F church-etal-2021-benchmarking %R 10.18653/v1/2021.bppf-1.1 %U https://aclanthology.org/2021.bppf-1.1 %U https://doi.org/10.18653/v1/2021.bppf-1.1 %P 1-7 %0 Conference Proceedings %T Guideline Bias in Wizard-of-Oz Dialogues %A Hansen, Victor Petrén Bach %A Søgaard, Anders %Y Church, Kenneth %Y Liberman, Mark %Y Kordoni, Valia %S Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future %D 2021 %8 August %I Association for Computational Linguistics %C Online %F hansen-sogaard-2021-guideline %R 10.18653/v1/2021.bppf-1.2 %U https://aclanthology.org/2021.bppf-1.2 %U https://doi.org/10.18653/v1/2021.bppf-1.2 %P 8-14 %0 Conference Proceedings %T We Need to Consider Disagreement in Evaluation %A Basile, Valerio %A Fell, Michael %A Fornaciari, Tommaso %A Hovy, Dirk %A Paun, Silviu %A Plank, Barbara %A Poesio, Massimo %A Uma, Alexandra %Y Church, Kenneth %Y Liberman, Mark %Y Kordoni, Valia %S Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future %D 2021 %8 August %I Association for Computational Linguistics %C Online %F basile-etal-2021-need %R 10.18653/v1/2021.bppf-1.3 %U https://aclanthology.org/2021.bppf-1.3 %U https://doi.org/10.18653/v1/2021.bppf-1.3 %P 15-21 %0 Conference Proceedings %T How Might We Create Better Benchmarks for Speech Recognition? %A Aksënova, Alëna %A van Esch, Daan %A Flynn, James %A Golik, Pavel %Y Church, Kenneth %Y Liberman, Mark %Y Kordoni, Valia %S Proceedings of the 1st Workshop on Benchmarking: Past, Present and Future %D 2021 %8 August %I Association for Computational Linguistics %C Online %F aksenova-etal-2021-might %R 10.18653/v1/2021.bppf-1.4 %U https://aclanthology.org/2021.bppf-1.4 %U https://doi.org/10.18653/v1/2021.bppf-1.4 %P 22-34