Let’s be explicit about that: Distant supervision for implicit discourse relation classification via connective prediction

Murathan Kurfalı, Robert Östling


Abstract
In implicit discourse relation classification, we want to predict the relation between adjacent sentences in the absence of any overt discourse connectives. This is challenging even for humans, leading to shortage of annotated data, a fact that makes the task even more difficult for supervised machine learning approaches. In the current study, we perform implicit discourse relation classification without relying on any labeled implicit relation. We sidestep the lack of data through explicitation of implicit relations to reduce the task to two sub-problems: language modeling and explicit discourse relation classification, a much easier problem. Our experimental results show that this method can even marginally outperform the state-of-the-art, in spite of being much simpler than alternative models of comparable performance. Moreover, we show that the achieved performance is robust across domains as suggested by the zero-shot experiments on a completely different domain. This indicates that recent advances in language modeling have made language models sufficiently good at capturing inter-sentence relations without the help of explicit discourse markers.
Anthology ID:
2021.unimplicit-1.1
Volume:
Proceedings of the 1st Workshop on Understanding Implicit and Underspecified Language
Month:
August
Year:
2021
Address:
Online
Venues:
ACL | IJCNLP | unimplicit
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–10
Language:
URL:
https://aclanthology.org/2021.unimplicit-1.1
DOI:
10.18653/v1/2021.unimplicit-1.1
Bibkey:
Cite (ACL):
Murathan Kurfalı and Robert Östling. 2021. Let’s be explicit about that: Distant supervision for implicit discourse relation classification via connective prediction. In Proceedings of the 1st Workshop on Understanding Implicit and Underspecified Language, pages 1–10, Online. Association for Computational Linguistics.
Cite (Informal):
Let’s be explicit about that: Distant supervision for implicit discourse relation classification via connective prediction (Kurfalı & Östling, unimplicit 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.unimplicit-1.1.pdf