Discourse Relation Embeddings: Representing the Relations between Discourse Segments in Social Media

Youngseo Son, Vasudha Varadarajan, H. Andrew Schwartz


Abstract
Discourse relations are typically modeled as a discrete class that characterizes the relation between segments of text (e.g. causal explanations, expansions). However, such predefined discrete classes limit the universe of potential relationships and their nuanced differences. Adding higher-level semantic structure to contextual word embeddings, we propose representing discourse relations as points in high dimensional continuous space. However, unlike words, discourse relations often have no surface form (relations are in between two segments, often with no word or phrase in that gap) which presents a challenge for existing embedding techniques. We present a novel method for automatically creating discourse relation embeddings (DiscRE), addressing the embedding challenge through a weakly supervised, multitask approach to learn diverse and nuanced relations in social media. Results show DiscRE representations obtain the best performance on Twitter discourse relation classification (macro F1=0.76), social media causality prediction (from F1=0.79 to 0.81), and perform beyond modern sentence and word transformers at traditional discourse relation classification, capturing novel nuanced relations (e.g. relations at the intersection of causal explanations and counterfactuals).
Anthology ID:
2022.umios-1.5
Volume:
Proceedings of the Workshop on Unimodal and Multimodal Induction of Linguistic Structures (UM-IoS)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Wenjuan Han, Zilong Zheng, Zhouhan Lin, Lifeng Jin, Yikang Shen, Yoon Kim, Kewei Tu
Venue:
UM-IoS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
45–55
Language:
URL:
https://aclanthology.org/2022.umios-1.5
DOI:
10.18653/v1/2022.umios-1.5
Bibkey:
Cite (ACL):
Youngseo Son, Vasudha Varadarajan, and H. Andrew Schwartz. 2022. Discourse Relation Embeddings: Representing the Relations between Discourse Segments in Social Media. In Proceedings of the Workshop on Unimodal and Multimodal Induction of Linguistic Structures (UM-IoS), pages 45–55, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Discourse Relation Embeddings: Representing the Relations between Discourse Segments in Social Media (Son et al., UM-IoS 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.umios-1.5.pdf