GapToCompliance: A Taxonomy-Driven Agentic AI Framework for Automated AI Act Gap Analysis and Remediation

Ilias Driouich, Hongliu Cao, Eoin Thomas


Abstract
Assessing regulatory compliance for high-risk AI systems requires systematic identification of technical gaps such as missing controls, inadequate processes, or shallow evaluation of practices. Compliance officers typically administer structured questionnaires collecting evidence of current practices, where organizations respond with descriptions of their existing processes, technical capabilities, and architectural choices. However, translating these compliance questionnaire responses into typed, actionable gap diagnoses remains unsystematic. In this paper, we present a literature-grounded taxonomy of technical compliance gaps covering areas such as accuracy, robustness, logging, and human oversight, and embed it in GapToCompliance, a two-stage agentic framework coordinating two specialized agents: a Gap Extraction Agent that performs hierarchical reasoning from compliance areas to specific gap types, and a Remediation Planning Agent that ranks remediation actions from a remediation catalog via multi-signal scoring combining semantic similarity, regulatory alignment, and effort estimation. We evaluate this framework against four automatic compliance gap detection baselines across 9 AI systems and 6 AI families. Our approach achieves a gap-type F1 of 0.831 (vs. 0.533 for the strongest baseline) and remediation P@5 of 0.872 (vs. 0.635 for retrieval methods), demonstrating promising potential for automated compliance workflows. The structured agent coordination reveals a path toward human-in-the-loop compliance systems where automated gap extraction reduces expert burden while maintaining auditability, and the taxonomy-driven design enables extension to emerging regulatory frameworks beyond the EU AI Act.
Anthology ID:
2026.nllp-1.38
Volume:
Proceedings of the Natural Legal Language Processing Workshop 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Nikolaos Aletras, Ilias Chalkidis, Leslie Barrett, Cătălina Goanță, Daniel Preoțiuc-Pietro, Gerasimos Spanakis, Shanshan Xu
Venues:
NLLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
456–467
Language:
URL:
https://aclanthology.org/2026.nllp-1.38/
DOI:
Bibkey:
Cite (ACL):
Ilias Driouich, Hongliu Cao, and Eoin Thomas. 2026. GapToCompliance: A Taxonomy-Driven Agentic AI Framework for Automated AI Act Gap Analysis and Remediation. In Proceedings of the Natural Legal Language Processing Workshop 2026, pages 456–467, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GapToCompliance: A Taxonomy-Driven Agentic AI Framework for Automated AI Act Gap Analysis and Remediation (Driouich et al., NLLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.nllp-1.38.pdf