From Legal Text to Executable Process: LLM-Based Extraction of DCR Determinations from Danish Administrative Law

Ali Al-Laith, Manex Agirrezabal


Abstract
Formal representations of legal text can ground conversational legal assistants in structured, verifiable knowledge rather than relying solely on a language models latent understanding. A key bottleneck in building such representations is extracting the underlying legal "determinations" from natural language documents. We investigate whether large language models can perform this extraction directly via prompting. We prompt six open-weight models to extract determinations from chunked sections of the document, and evaluate their output against a manually built gold standard using both character-level and semantic metrics, in both gold-to-predicted and predicted-to-gold directions, alongside a novel pseudo-precision/recall formulation. Results show that models vary substantially in schema conformance, output length, and number of determinations retrieved, with no single model dominating across all metrics: some achieve stronger semantic alignment with gold determinations, while others better preserve one-to-one correspondence in the reverse direction.
Anthology ID:
2026.nllp-1.50
Volume:
Proceedings of the Natural Legal Language Processing Workshop 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Nikolaos Aletras, Ilias Chalkidis, Leslie Barrett, Cătălina Goanță, Daniel Preoțiuc-Pietro, Gerasimos Spanakis, Shanshan Xu
Venues:
NLLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
640
Language:
URL:
https://aclanthology.org/2026.nllp-1.50/
DOI:
Bibkey:
Cite (ACL):
Ali Al-Laith and Manex Agirrezabal. 2026. From Legal Text to Executable Process: LLM-Based Extraction of DCR Determinations from Danish Administrative Law. In Proceedings of the Natural Legal Language Processing Workshop 2026, pages 640–640, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
From Legal Text to Executable Process: LLM-Based Extraction of DCR Determinations from Danish Administrative Law (Al-Laith & Agirrezabal, NLLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nllp-1.50.pdf