Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks

Wei Liu, Xiyan Fu, Michael Strube


Abstract
Coherence is an important aspect of text quality, and various approaches have been applied to coherence modeling. However, existing methods solely focus on a single document’s coherence patterns, ignoring the underlying correlation between documents. We investigate a GCN-based coherence model that is capable of capturing structural similarities between documents. Our model first creates a graph structure for each document, from where we mine different subgraph patterns. We then construct a heterogeneous graph for the training corpus, connecting documents based on their shared subgraphs. Finally, a GCN is applied to the heterogeneous graph to model the connectivity relationships. We evaluate our method on two tasks, assessing discourse coherence and automated essay scoring. Results show that our GCN-based model outperforms all baselines, achieving a new state-of-the-art on both tasks.
Anthology ID:
2023.acl-long.431
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7792–7808
Language:
URL:
https://aclanthology.org/2023.acl-long.431
DOI:
10.18653/v1/2023.acl-long.431
Bibkey:
Cite (ACL):
Wei Liu, Xiyan Fu, and Michael Strube. 2023. Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7792–7808, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Modeling Structural Similarities between Documents for Coherence Assessment with Graph Convolutional Networks (Liu et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.431.pdf
Video:
 https://aclanthology.org/2023.acl-long.431.mp4