Sentence Ordering with a Coherence Verifier

Sainan Jia, Wei Song, Jiefu Gong, Shijin Wang, Ting Liu


Abstract
This paper presents a novel sentence ordering method by plugging a coherence verifier (CoVer) into pair-wise ranking-based and sequence generation-based methods. It does not change the model parameters of the baseline, and only verifies the coherence of candidate (partial) orders produced by the baseline and reranks them in beam search. We also propose a coherence model as CoVer with a novel graph formulation and a novel data construction strategy for contrastive pre-training independently of the sentence ordering task. Experimental results on four benchmarks demonstrate the effectiveness of our method with topological sorting-based and pointer network-based methods as the baselines. Detailed analyses illustrate how CoVer improves the baselines and confirm the importance of its graph formulation and training strategy. Our code is available at https://github.com/SN-Jia/SO_with_CoVer.
Anthology ID:
2023.findings-acl.592
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9301–9314
Language:
URL:
https://aclanthology.org/2023.findings-acl.592
DOI:
10.18653/v1/2023.findings-acl.592
Bibkey:
Cite (ACL):
Sainan Jia, Wei Song, Jiefu Gong, Shijin Wang, and Ting Liu. 2023. Sentence Ordering with a Coherence Verifier. In Findings of the Association for Computational Linguistics: ACL 2023, pages 9301–9314, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Sentence Ordering with a Coherence Verifier (Jia et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.592.pdf