Extract, Integrate, Compete: Towards Verification Style Reading Comprehension

Chen Zhang, Yuxuan Lai, Yansong Feng, Dongyan Zhao


Abstract
In this paper, we present a new verification style reading comprehension dataset named VGaokao from Chinese Language tests of Gaokao. Different from existing efforts, the new dataset is originally designed for native speakers’ evaluation, thus requiring more advanced language understanding skills. To address the challenges in VGaokao, we propose a novel Extract-Integrate-Compete approach, which iteratively selects complementary evidence with a novel query updating mechanism and adaptively distills supportive evidence, followed by a pairwise competition to push models to learn the subtle difference among similar text pieces. Experiments show that our methods outperform various baselines on VGaokao with retrieved complementary evidence, while having the merits of efficiency and explainability. Our dataset and code are released for further research.
Anthology ID:
2021.findings-emnlp.255
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2021
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2976–2986
Language:
URL:
https://aclanthology.org/2021.findings-emnlp.255
DOI:
10.18653/v1/2021.findings-emnlp.255
Bibkey:
Cite (ACL):
Chen Zhang, Yuxuan Lai, Yansong Feng, and Dongyan Zhao. 2021. Extract, Integrate, Compete: Towards Verification Style Reading Comprehension. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 2976–2986, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Extract, Integrate, Compete: Towards Verification Style Reading Comprehension (Zhang et al., Findings 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.findings-emnlp.255.pdf
Video:
 https://aclanthology.org/2021.findings-emnlp.255.mp4
Code
 luciusssss/VGaokao
Data
VGaokaoC3FEVERRACE