InLegalLaySum: A Novel Benchmark for Lay Summarization of Indian Legal Documents

Trishita Saha, Debtanu Datta, Shubham Tiwari, Mohit Kaushal, Priyank Rathore, Mohammad Khalid Pandit, Pawan Goyal, Saptarshi Ghosh


Abstract
Legal documents are often lengthy and contain domain-specific terminology and complex legal reasoning, making them difficult for the general public to understand. This challenge is further amplified in the Indian context, where a large portion of the population lacks proficiency in complex English. Although automatic legal summarization has been studied, most existing approaches generate summaries intended for legal professionals and thus remain difficult for laypeople. To address this gap, we introduce InLegalLaySum, the first benchmark for lay summarization of Indian legal documents. InLegalLaySum comprises 9,570 judgements from the Supreme Court and several High Courts of India paired with expert-written summaries in English. We benchmark a wide range of generative models (ranging from 160M to 7B parameters) and perform comprehensive experiments with multiple training strategies, including supervised fine-tuning (SFT) and direct preference optimization (DPO). We observed that the hybrid SFT+DPO training achieved superior performance across readability metrics, which is further validated by domain experts.
Anthology ID:
2026.findings-aacl.156
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3099–3123
Language:
URL:
https://aclanthology.org/2026.findings-aacl.156/
DOI:
Bibkey:
Cite (ACL):
Trishita Saha, Debtanu Datta, Shubham Tiwari, Mohit Kaushal, Priyank Rathore, Mohammad Khalid Pandit, Pawan Goyal, and Saptarshi Ghosh. 2026. InLegalLaySum: A Novel Benchmark for Lay Summarization of Indian Legal Documents. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 3099–3123, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
InLegalLaySum: A Novel Benchmark for Lay Summarization of Indian Legal Documents (Saha et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.156.pdf