Schematize: An Agentic System for Generating and Refining Information-Extraction Schemas for Legal Research

Albert Sawczyn, Jakub Binkowski, Kamil Tagowski, Lukasz Augustyniak, Berenika Kaczmarek-Templin, Tomasz Jan Kajdanowicz


Abstract
Empirical legal research often relies on turning research questions into structured data extracted from large collections of rulings and judgments. Designing the extraction schema and then extracting the data remain a manual, expertise-heavy bottleneck. We present schematize, an open-source multi-agent system that interactively turns a researcher’s problem statement into a validated extraction schema that can later be used for autonomous extraction. Schematize couples (i) a clarification dialogue that elicits implicit expert intent, (ii) iterative schema generation, (iii) data-grounded refinement that tests the schema against documents, and (iv) chat-based post-editing. We evaluated the system with human legal professional, introducing our novel methodology, and schematize achieves top performance in most of tested configurations. While the system is designed to be domain-agnostic and applicable to any document collection, we tailor and evaluate it on legal research problems. We release schematize as a pip-installable Python package with full documentation.
Anthology ID:
2026.emnlp-demos.66
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
696–705
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.66/
DOI:
Bibkey:
Cite (ACL):
Albert Sawczyn, Jakub Binkowski, Kamil Tagowski, Lukasz Augustyniak, Berenika Kaczmarek-Templin, and Tomasz Jan Kajdanowicz. 2026. Schematize: An Agentic System for Generating and Refining Information-Extraction Schemas for Legal Research. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 696–705, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Schematize: An Agentic System for Generating and Refining Information-Extraction Schemas for Legal Research (Sawczyn et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.66.pdf