Parthenon Law: A Self-Evolving Legal-Agent Framework

Hejia Geng, Yuxuan Liu


Abstract
As agents grow more capable, legal-domain LLM agents promise to turn document-heavy matters into reviewable work products—yet reliable deployment faces three obstacles: no large-scale evidence on how today’s strongest model-and-harness combinations behave on end-to-end legal matters; no agent architecture adapted to the legal vertical, only general-purpose harnesses; and, in a setting that keeps shifting with new facts, authorities, and deadlines, no mechanism for systems to learn from their own outcomes. We address each. A large-scale empirical study on Harvey LAB—12,510 agent trajectories—shows that even frontier agents remain far from completing matters in a single pass: per-criterion accuracy climbs with stronger models while strict matter completion stalls. We then introduce Parthenon, a self-evolving legal-agent framework that factors Model, Harness, Agent roles, legal Knowledge, deterministic Tools, and procedural Skills into auditable surfaces for source traceability, date and number grounding, deliverable compliance, and issue closure. Finally, an anti-leakage learning loop converts scored failures into task-agnostic edits to skills, tools, and knowledge, letting the system improve with experience—as a firm refines its checklists and playbooks after each matter—without touching model weights. Across our large-scale empirical analysis, Parthenon substantially improves the performance of state-of-the-art models and harnesses on legal-matter tasks.
Anthology ID:
2026.emnlp-industry.28
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pepa Atanasova, Gholamreza Haffari, Minghan Wang
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
456–480
Language:
URL:
https://aclanthology.org/2026.emnlp-industry.28/
DOI:
Bibkey:
Cite (ACL):
Hejia Geng and Yuxuan Liu. 2026. Parthenon Law: A Self-Evolving Legal-Agent Framework. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 456–480, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Parthenon Law: A Self-Evolving Legal-Agent Framework (Geng & Liu, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-industry.28.pdf