ResearchTeam_HCN at SemEval-2023 Task 6: A knowledge enhanced transformers based legal NLP system

Dhanachandra Ningthoujam, Pinal Patel, Rajkamal Kareddula, Ramanand Vangipuram


Abstract
This paper presents our work on LegalEval (understanding legal text), one of the tasks in SemEval-2023. It comprises of three sub-tasks namely Rhetorical Roles (RR), Legal Named Entity Recognition (L-NER), and Court Judge- ment Prediction with Explanation (CJPE). We developed different deep-learning models for each sub-tasks. For RR, we developed a multi- task learning model with contextual sequential sentence classification as the main task and non- contextual single sentence prediction as the sec- ondary task. Our model achieved an F1-score of 76.50% on the unseen test set, and we at- tained the 14th position on the leaderboard. For the L-NER problem, we have designed a hybrid model, consisting of a multi-stage knowledge transfer learning framework and a rule-based system. This model achieved an F1-score of 91.20% on the blind test set and attained the top position on the final leaderboard. Finally, for the CJPE task, we used a hierarchical ap- proach and could get around 66.67% F1-score on judgment prediction and 45.83% F1-score on the explainability of the CJPE task, and we attained 8th position on the leaderboard for this sub-task.
Anthology ID:
2023.semeval-1.173
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1245–1253
Language:
URL:
https://aclanthology.org/2023.semeval-1.173
DOI:
10.18653/v1/2023.semeval-1.173
Bibkey:
Cite (ACL):
Dhanachandra Ningthoujam, Pinal Patel, Rajkamal Kareddula, and Ramanand Vangipuram. 2023. ResearchTeam_HCN at SemEval-2023 Task 6: A knowledge enhanced transformers based legal NLP system. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1245–1253, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
ResearchTeam_HCN at SemEval-2023 Task 6: A knowledge enhanced transformers based legal NLP system (Ningthoujam et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.173.pdf