IRIT_IRIS_A at SemEval-2023 Task 6: Legal Rhetorical Role Labeling Supported by Dynamic-Filled Contextualized Sentence Chunks

Alexandre Gomes de Lima, Jose G. Moreno, Eduardo H. da S. Aranha


Abstract
This work presents and evaluates an approach to efficiently leverage the context exploitation ability of pre-trained Transformer models as a way of boosting the performance of models tackling the Legal Rhetorical Role Labeling task. The core idea is to feed the model with sentence chunks that are assembled in a way that avoids the insertion of padding tokens and the truncation of sentences and, hence, obtain better sentence embeddings. The achieved results show that our proposal is efficient, despite its simplicity, since models based on it overcome strong baselines by 3.76% in the worst case and by 8.71% in the best case.
Anthology ID:
2023.semeval-1.125
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
905–912
Language:
URL:
https://aclanthology.org/2023.semeval-1.125
DOI:
10.18653/v1/2023.semeval-1.125
Bibkey:
Cite (ACL):
Alexandre Gomes de Lima, Jose G. Moreno, and Eduardo H. da S. Aranha. 2023. IRIT_IRIS_A at SemEval-2023 Task 6: Legal Rhetorical Role Labeling Supported by Dynamic-Filled Contextualized Sentence Chunks. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 905–912, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
IRIT_IRIS_A at SemEval-2023 Task 6: Legal Rhetorical Role Labeling Supported by Dynamic-Filled Contextualized Sentence Chunks (Lima et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.125.pdf