Cohere: A Toolkit for Local Coherence

Karin Sim Smith, Wilker Aziz, Lucia Specia


Abstract
We describe COHERE, our coherence toolkit which incorporates various complementary models for capturing and measuring different aspects of text coherence. In addition to the traditional entity grid model (Lapata, 2005) and graph-based metric (Guinaudeau and Strube, 2013), we provide an implementation of a state-of-the-art syntax-based model (Louis and Nenkova, 2012), as well as an adaptation of this model which shows significant performance improvements in our experiments. We benchmark these models using the standard setting for text coherence: original documents and versions of the document with sentences in shuffled order.
Anthology ID:
L16-1649
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4111–4114
Language:
URL:
https://aclanthology.org/L16-1649
DOI:
Bibkey:
Cite (ACL):
Karin Sim Smith, Wilker Aziz, and Lucia Specia. 2016. Cohere: A Toolkit for Local Coherence. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 4111–4114, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Cohere: A Toolkit for Local Coherence (Smith et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1649.pdf
Code
 karins/CoherenceFramework