Interrater Disagreement Resolution: A Systematic Procedure to Reach Consensus in Annotation Tasks Yvette Oortwijn author Thijs Ossenkoppele author Arianna Betti author 2021-04 text Proceedings of the Workshop on Human Evaluation of NLP Systems (HumEval) Anya Belz editor Shubham Agarwal editor Yvette Graham editor Ehud Reiter editor Anastasia Shimorina editor Association for Computational Linguistics Online conference publication oortwijn-etal-2021-interrater https://aclanthology.org/2021.humeval-1.15/ 2021-04 131 141