Semantic Sentence Matching via Interacting Syntax Graphs

Chen Xu, Jun Xu, Zhenhua Dong, Ji-Rong Wen


Abstract
Studies have shown that the sentence’s syntactic structures are important for semantic sentence matching. A typical approach is encoding each sentence’s syntactic structure into an embedding vector, which can be combined with other features to predict the final matching scores. Though successes have been observed, embedding the whole syntactic structures as one vector inevitably overlooks the fine-grained syntax matching patterns, e.g. the alignment of specific term dependencies relations in the two inputted sentences. In this paper, we formalize the task of semantic sentence matching as a problem of graph matching in which each sentence is represented as a directed graph according to its syntactic structures. The syntax matching patterns (i.e. similar syntactic structures) between two sentences, therefore, can be extracted as the sub-graph structure alignments. The proposed method, referred to as Interacted Syntax Graphs (ISG), represents two sentences’ syntactic alignments as well as their semantic matching signals into one association graph. After that, the neural quadratic assignment programming (QAP) is adapted to extract syntactic matching patterns from the association graph. In this way, the syntactic structures fully interact in a fine granularity during the matching process. Experimental results on three public datasets demonstrated that ISG can outperform the state-of-the-art baselines effectively and efficiently. The empirical analysis also showed that ISG can match sentences in an interpretable way.
Anthology ID:
2022.coling-1.78
Volume:
Proceedings of the 29th International Conference on Computational Linguistics
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
938–949
Language:
URL:
https://aclanthology.org/2022.coling-1.78
DOI:
Bibkey:
Cite (ACL):
Chen Xu, Jun Xu, Zhenhua Dong, and Ji-Rong Wen. 2022. Semantic Sentence Matching via Interacting Syntax Graphs. In Proceedings of the 29th International Conference on Computational Linguistics, pages 938–949, Gyeongju, Republic of Korea. International Committee on Computational Linguistics.
Cite (Informal):
Semantic Sentence Matching via Interacting Syntax Graphs (Xu et al., COLING 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.coling-1.78.pdf
Data
SNLI