Ontology-Guided Procedural Knowledge Extraction and Validation Case Study on the Lockout-Tagout Documents

Cennet Oguz, Noon Pokaratsiri Goldstein, Jörg Steffen, Reetam Biswas, Günter Neumann


Abstract
We present a case study developing an ontology-guided framework for extracting and validating procedural knowledge from safety-critical documents with limited annotations, specifically the Lockout-Tagout (LOTO) procedural documents. We build multimodal Procedural Knowledge Graphs (PKGs) grounded in the Procedural Knowledge Ontology (PKO) from text and diagrams using LLMs and VLMs. The extracted PKGs are evaluated on instruction- and graph-level metrics with validation against a domain expert curated ontology for action–entity relations, step order, and cross-modal alignment. Embedding-based metrics capture semantic alignment, while lexical metrics expose safety-critical mismatches. Our experiments on proprietary and public LOTO documents demonstrate the feasibility and limitations of multimodal procedural extraction and motivate ontology-guided validation.
Anthology ID:
2026.docinsights-1.16
Volume:
The Proceedings of Workshop on Document Intelligence and Understanding
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Santosh T.Y.S.S., Amit Agarwal, Vivek Gupta, Yova Kementchedjhieva, Aparna Garimella, Yufang Hou
Venues:
DocInsights | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
217–231
Language:
URL:
https://aclanthology.org/2026.docinsights-1.16/
DOI:
Bibkey:
Cite (ACL):
Cennet Oguz, Noon Pokaratsiri Goldstein, Jörg Steffen, Reetam Biswas, and Günter Neumann. 2026. Ontology-Guided Procedural Knowledge Extraction and Validation Case Study on the Lockout-Tagout Documents. In The Proceedings of Workshop on Document Intelligence and Understanding, pages 217–231, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Ontology-Guided Procedural Knowledge Extraction and Validation Case Study on the Lockout-Tagout Documents (Oguz et al., DocInsights 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.docinsights-1.16.pdf