Intra-Correlation Encoding for Chinese Sentence Intention Matching

Xu Zhang, Yifeng Li, Wenpeng Lu, Ping Jian, Guoqiang Zhang


Abstract
Sentence intention matching is vital for natural language understanding. Especially for Chinese sentence intention matching task, due to the ambiguity of Chinese words, semantic missing or semantic confusion are more likely to occur in the encoding process. Although the existing methods have enriched text representation through pre-trained word embedding to solve this problem, due to the particularity of Chinese text, different granularities of pre-trained word embedding will affect the semantic description of a piece of text. In this paper, we propose an effective approach that combines character-granularity and word-granularity features to perform sentence intention matching, and we utilize soft alignment attention to enhance the local information of sentences on the corresponding levels. The proposed method can capture sentence feature information from multiple perspectives and correlation information between different levels of sentences. By evaluating on BQ and LCQMC datasets, our model has achieved remarkable results, and demonstrates better or comparable performance with BERT-based models.
Anthology ID:
2020.coling-main.455
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
5193–5204
Language:
URL:
https://aclanthology.org/2020.coling-main.455
DOI:
10.18653/v1/2020.coling-main.455
Bibkey:
Cite (ACL):
Xu Zhang, Yifeng Li, Wenpeng Lu, Ping Jian, and Guoqiang Zhang. 2020. Intra-Correlation Encoding for Chinese Sentence Intention Matching. In Proceedings of the 28th International Conference on Computational Linguistics, pages 5193–5204, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
Intra-Correlation Encoding for Chinese Sentence Intention Matching (Zhang et al., COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.455.pdf
Code
 xuzhangp/ice