Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts

Shubham Nigam, Anurag Sharma, Danush Khanna, Noel Shallum, Kripabandhu Ghosh, Arnab Bhattacharya


Abstract
In the era of Large Language Models (LLMs), predicting judicial outcomes poses significant challenges due to the complexity of legal proceedings and the scarcity of expert-annotated datasets. Addressing this, we introduce Prediction with Explanation (PredEx), the largest expert-annotated dataset for legal judgment prediction and explanation in the Indian context, featuring over 15,000 annotations. This groundbreaking corpus significantly enhances the training and evaluation of AI models in legal analysis, with innovations including the application of instruction tuning to LLMs. This method has markedly improved the predictive accuracy and explanatory depth of these models for legal judgments. We employed various transformer-based models, tailored for both general and Indian legal contexts. Through rigorous lexical, semantic, and expert assessments, our models effectively leverage PredEx to provide precise predictions and meaningful explanations, establishing it as a valuable benchmark for both the legal profession and the NLP community.
Anthology ID:
2024.findings-acl.255
Volume:
Findings of the Association for Computational Linguistics ACL 2024
Month:
August
Year:
2024
Address:
Bangkok, Thailand and virtual meeting
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4296–4315
Language:
URL:
https://aclanthology.org/2024.findings-acl.255
DOI:
Bibkey:
Cite (ACL):
Shubham Nigam, Anurag Sharma, Danush Khanna, Noel Shallum, Kripabandhu Ghosh, and Arnab Bhattacharya. 2024. Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts. In Findings of the Association for Computational Linguistics ACL 2024, pages 4296–4315, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics.
Cite (Informal):
Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts (Nigam et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-acl.255.pdf