IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations

Shangmin Guo, Kang Liu, Shizhu He, Cao Liu, Jun Zhao, Zhuoyu Wei


Abstract
The IJCNLP-2017 Multi-choice Question Answering(MCQA) task aims at exploring the performance of current Question Answering(QA) techniques via the realworld complex questions collected from Chinese Senior High School Entrance Examination papers and CK12 website1. The questions are all 4-way multi-choice questions writing in Chinese and English respectively that cover a wide range of subjects, e.g. Biology, History, Life Science and etc. And, all questions are restrained within the elementary and middle school level. During the whole procedure of this task, 7 teams submitted 323 runs in total. This paper describes the collected data, the format and size of these questions, formal run statistics and results, overview and performance statistics of different methods
Anthology ID:
I17-4005
Volume:
Proceedings of the IJCNLP 2017, Shared Tasks
Month:
December
Year:
2017
Address:
Taipei, Taiwan
Editors:
Chao-Hong Liu, Preslav Nakov, Nianwen Xue
Venue:
IJCNLP
SIG:
Publisher:
Asian Federation of Natural Language Processing
Note:
Pages:
34–40
Language:
URL:
https://aclanthology.org/I17-4005
DOI:
Bibkey:
Cite (ACL):
Shangmin Guo, Kang Liu, Shizhu He, Cao Liu, Jun Zhao, and Zhuoyu Wei. 2017. IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations. In Proceedings of the IJCNLP 2017, Shared Tasks, pages 34–40, Taipei, Taiwan. Asian Federation of Natural Language Processing.
Cite (Informal):
IJCNLP-2017 Task 5: Multi-choice Question Answering in Examinations (Guo et al., IJCNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/I17-4005.pdf
Data
IGC