ELLA: Empowering LLMs for Interpretable, Accurate and Informative Legal Advice

Yutong Hu, Kangcheng Luo, Yansong Feng


Abstract
Despite remarkable performance in legal consultation exhibited by legal Large Language Models(LLMs) combined with legal article retrieval components, there are still cases when the advice given is incorrect or baseless. To alleviate these problems, we propose ELLA, a tool for Empowering LLMs for interpretable, accurate, and informative Legal Advice. ELLA visually presents the correlation between legal articles and LLM’s response by calculating their similarities, providing users with an intuitive legal basis for the responses. Besides, based on the users’ queries, ELLA retrieves relevant legal articles and displays them to users. Users can interactively select legal articles for LLM to generate more accurate responses. ELLA also retrieves relevant legal cases for user reference. Our user study shows that presenting the legal basis for the response helps users understand better. The accuracy of LLM’s responses also improves when users intervene in selecting legal articles for LLM. Providing relevant legal cases also aids individuals in obtaining comprehensive information. Our github repo is: https://github.com/Huyt00/ELLA.
Anthology ID:
2024.acl-demos.36
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Yixin Cao, Yang Feng, Deyi Xiong
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
374–387
Language:
URL:
https://aclanthology.org/2024.acl-demos.36
DOI:
10.18653/v1/2024.acl-demos.36
Bibkey:
Cite (ACL):
Yutong Hu, Kangcheng Luo, and Yansong Feng. 2024. ELLA: Empowering LLMs for Interpretable, Accurate and Informative Legal Advice. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), pages 374–387, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
ELLA: Empowering LLMs for Interpretable, Accurate and Informative Legal Advice (Hu et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-demos.36.pdf