Multi-Level Implicit Discourse Relation Classification via Sequence-Level Reinforcement Learning

Wei Liu, Xiaoyu Shen, Xiyan Fu


Abstract
Implicit Discourse Relation Classification (IDRC) identifies discourse relations between text spans when connectives are absent. The task is typically evaluated on the Penn Discourse Treebank (PDTB), where discourse senses are organized in a hierarchical structure. Recent unified models predict discourse labels level by level under teacher forcing, which leads to exposure bias and cascading errors across the hierarchy. Moreover, token-level training objectives fail to assess the correctness of the entire label sequence. We reformulate multi-level IDRC as hierarchical label sequence generation and optimize the full label sequence using sequence-level reinforcement learning. By sampling and ranking complete label sequences, the proposed framework directly optimizes global sequence correctness rather than isolated token-level decisions. Experiments on PDTB 2.0 and 3.0 demonstrate consistent improvements over strong baselines. Further analysis shows that fine-to-coarse decoding outperforms the conventional coarse-to-fine strategy, highlighting the importance of decoding order in hierarchical discourse modeling.
Anthology ID:
2026.emnlp-main.1801
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
41027–41040
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1801/
DOI:
Bibkey:
Cite (ACL):
Wei Liu, Xiaoyu Shen, and Xiyan Fu. 2026. Multi-Level Implicit Discourse Relation Classification via Sequence-Level Reinforcement Learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 41027–41040, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Multi-Level Implicit Discourse Relation Classification via Sequence-Level Reinforcement Learning (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1801.pdf