%0 Conference Proceedings %T Chengyu Cloze Test %A Jiang, Zhiying %A Zhang, Boliang %A Huang, Lifu %A Ji, Heng %Y Tetreault, Joel %Y Burstein, Jill %Y Kochmar, Ekaterina %Y Leacock, Claudia %Y Yannakoudakis, Helen %S Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications %D 2018 %8 June %I Association for Computational Linguistics %C New Orleans, Louisiana %F jiang-etal-2018-chengyu %X We present a neural recommendation model for Chengyu, which is a special type of Chinese idiom. Given a query, which is a sentence with an empty slot where the Chengyu is taken out, our model will recommend the best Chengyu candidate that best fits the slot context. The main challenge lies in that the literal meaning of a Chengyu is usually very different from it’s figurative meaning. We propose a new neural approach to leverage the definition of each Chengyu and incorporate it as background knowledge. Experiments on both Chengyu cloze test and coherence checking in college entrance exams show that our system achieves 89.5% accuracy on cloze test and outperforms human subjects who attended competitive universities in China. We will make all of our data sets and resources publicly available as a new benchmark for research purposes. %R 10.18653/v1/W18-0516 %U https://aclanthology.org/W18-0516 %U https://doi.org/10.18653/v1/W18-0516 %P 154-158