Cross-Clinic De-Identification of Swedish Electronic Health Records: Nuances and Caveats

Olle Bridal, Thomas Vakili, Marina Santini


Abstract
Privacy preservation of sensitive information is one of the main concerns in clinical text mining. Due to the inherent privacy risks of handling clinical data, the clinical corpora used to create the clinical Named Entity Recognition (NER) models underlying clinical de-identification systems cannot be shared. This situation implies that clinical NER models are trained and tested on data originating from the same institution since it is rarely possible to evaluate them on data belonging to a different organization. These restrictions on sharing make it very difficult to assess whether a clinical NER model has overfitted the data or if it has learned any undetected biases. This paper presents the results of the first-ever cross-institution evaluation of a Swedish de-identification system on Swedish clinical data. Alongside the encouraging results, we discuss differences and similarities across EHR naming conventions and NER tagsets.
Anthology ID:
2022.legal-1.10
Volume:
Proceedings of the Workshop on Ethical and Legal Issues in Human Language Technologies and Multilingual De-Identification of Sensitive Data In Language Resources within the 13th Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Ingo Siegert, Mickael Rigault, Victoria Arranz
Venue:
LEGAL
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
49–52
Language:
URL:
https://aclanthology.org/2022.legal-1.10
DOI:
Bibkey:
Cite (ACL):
Olle Bridal, Thomas Vakili, and Marina Santini. 2022. Cross-Clinic De-Identification of Swedish Electronic Health Records: Nuances and Caveats. In Proceedings of the Workshop on Ethical and Legal Issues in Human Language Technologies and Multilingual De-Identification of Sensitive Data In Language Resources within the 13th Language Resources and Evaluation Conference, pages 49–52, Marseille, France. European Language Resources Association.
Cite (Informal):
Cross-Clinic De-Identification of Swedish Electronic Health Records: Nuances and Caveats (Bridal et al., LEGAL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.legal-1.10.pdf