Revisiting the Self-Consistency Challenges in Multi-Choice Question Formats for Large Language Model Evaluation

Revisiting the Self-Consistency Challenges in Multi-Choice Question Formats for Large Language Model Evaluation Wenjie Zhou author Qiang Wang author Mingzhou Xu author Ming Chen author Xiangyu Duan author 2024-05 text Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) Nicoletta Calzolari editor Min-Yen Kan editor Veronique Hoste editor Alessandro Lenci editor Sakriani Sakti editor Nianwen Xue editor ELRA and ICCL Torino, Italia conference publication zhou-etal-2024-revisiting https://aclanthology.org/2024.lrec-main.1229/ 2024-05 14103 14110