DisCut and DiscReT: MELODI at DISRPT 2023

Eleni Metheniti, Chloé Braud, Philippe Muller, Laura Rivière


Abstract
This paper presents the results obtained by the MELODI team for the three tasks proposed within the DISRPT 2023 shared task on discourse: segmentation, connective identification, and relation classification. The competition involves corpora in various languages in several underlying frameworks, and proposes two tracks depending on the presence or not of annotations of sentence boundaries and syntactic information. For these three tasks, we rely on a transformer-based architecture, and investigate several optimizations of the models, including hyper-parameter search and layer freezing. For discourse relations, we also explore the use of adapters—a lightweight solution for model fine-tuning—and introduce relation mappings to partially deal with the label set explosion we are facing within the setting of the shared task in a multi-corpus perspective. In the end, we propose one single architecture for segmentation and connectives, based on XLM-RoBERTa large, freezed at lower layers, with new state-of-the-art results for segmentation, and we propose 3 different models for relations, since the task makes it harder to generalize across all corpora.
Anthology ID:
2023.disrpt-1.3
Volume:
Proceedings of the 3rd Shared Task on Discourse Relation Parsing and Treebanking (DISRPT 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Chloé Braud, Yang Janet Liu, Eleni Metheniti, Philippe Muller, Laura Rivière, Attapol Rutherford, Amir Zeldes
Venue:
DISRPT
SIG:
Publisher:
The Association for Computational Linguistics
Note:
Pages:
29–42
Language:
URL:
https://aclanthology.org/2023.disrpt-1.3
DOI:
10.18653/v1/2023.disrpt-1.3
Bibkey:
Cite (ACL):
Eleni Metheniti, Chloé Braud, Philippe Muller, and Laura Rivière. 2023. DisCut and DiscReT: MELODI at DISRPT 2023. In Proceedings of the 3rd Shared Task on Discourse Relation Parsing and Treebanking (DISRPT 2023), pages 29–42, Toronto, Canada. The Association for Computational Linguistics.
Cite (Informal):
DisCut and DiscReT: MELODI at DISRPT 2023 (Metheniti et al., DISRPT 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.disrpt-1.3.pdf