IRIT_IRIS_C at SemEval-2023 Task 6: A Multi-level Encoder-based Architecture for Judgement Prediction of Legal Cases and their Explanation

Nishchal Prasad, Mohand Boughanem, Taoufiq Dkaki


Abstract
This paper describes our system used for sub-task C (1 & 2) in Task 6: LegalEval: Understanding Legal Texts. We propose a three-level encoder-based classification architecture that works by fine-tuning a BERT-based pre-trained encoder, and post-processing the embeddings extracted from its last layers, using transformer encoder layers and RNNs. We run ablation studies on the same and analyze itsperformance. To extract the explanations for the predicted class we develop an explanation extraction algorithm, exploiting the idea of a model’s occlusion sensitivity. We explored some training strategies with a detailed analysis of the dataset. Our system ranks 2nd (macro-F1 metric) for its sub-task C-1 and 7th (ROUGE-2 metric) for sub-task C-2.
Anthology ID:
2023.semeval-1.94
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
686–692
Language:
URL:
https://aclanthology.org/2023.semeval-1.94
DOI:
10.18653/v1/2023.semeval-1.94
Bibkey:
Cite (ACL):
Nishchal Prasad, Mohand Boughanem, and Taoufiq Dkaki. 2023. IRIT_IRIS_C at SemEval-2023 Task 6: A Multi-level Encoder-based Architecture for Judgement Prediction of Legal Cases and their Explanation. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 686–692, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
IRIT_IRIS_C at SemEval-2023 Task 6: A Multi-level Encoder-based Architecture for Judgement Prediction of Legal Cases and their Explanation (Prasad et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.94.pdf