%0 Conference Proceedings %T DisCoDisCo at the DISRPT2021 Shared Task: A System for Discourse Segmentation, Classification, and Connective Detection %A Gessler, Luke %A Behzad, Shabnam %A Liu, Yang Janet %A Peng, Siyao %A Zhu, Yilun %A Zeldes, Amir %Y Zeldes, Amir %Y Liu, Yang Janet %Y Iruskieta, Mikel %Y Muller, Philippe %Y Braud, Chloé %Y Badene, Sonia %S Proceedings of the 2nd Shared Task on Discourse Relation Parsing and Treebanking (DISRPT 2021) %D 2021 %8 November %I Association for Computational Linguistics %C Punta Cana, Dominican Republic %F gessler-etal-2021-discodisco %X This paper describes our submission to the DISRPT2021 Shared Task on Discourse Unit Segmentation, Connective Detection, and Relation Classification. Our system, called DisCoDisCo, is a Transformer-based neural classifier which enhances contextualized word embeddings (CWEs) with hand-crafted features, relying on tokenwise sequence tagging for discourse segmentation and connective detection, and a feature-rich, encoder-less sentence pair classifier for relation classification. Our results for the first two tasks outperform SOTA scores from the previous 2019 shared task, and results on relation classification suggest strong performance on the new 2021 benchmark. Ablation tests show that including features beyond CWEs are helpful for both tasks, and a partial evaluation of multiple pretrained Transformer-based language models indicates that models pre-trained on the Next Sentence Prediction (NSP) task are optimal for relation classification. %R 10.18653/v1/2021.disrpt-1.6 %U https://aclanthology.org/2021.disrpt-1.6 %U https://doi.org/10.18653/v1/2021.disrpt-1.6 %P 51-62