RRED : A Radiology Report Error Detector based on Deep Learning Framework

Dabin Min, Kaeun Kim, Jong Hyuk Lee, Yisak Kim, Chang Min Park


Abstract
Radiology report is an official record of radiologists’ interpretation of patients’ radiographs and it’s a crucial component in the overall medical diagnostic process. However, it can contain various types of errors that can lead to inadequate treatment or delay in diagnosis. To address this problem, we propose a deep learning framework to detect errors in radiology reports. Specifically, our method detects errors between findings and conclusion of chest X-ray reports based on a supervised learning framework. To compensate for the lack of data availability of radiology reports with errors, we develop an error generator to systematically create artificial errors in existing reports. In addition, we introduce a Medical Knowledge-enhancing Pre-training to further utilize the knowledge of abbreviations and key phrases frequently used in the medical domain. We believe that this is the first work to propose a deep learning framework for detecting errors in radiology reports based on a rich contextual and medical understanding. Validation on our radiologist-synthesized dataset, based on MIMIC-CXR, shows 0.80 and 0.95 of the area under precision-recall curve (AUPRC) and the area under the ROC curve (AUROC) respectively, indicating that our framework can effectively detect errors in the real-world radiology reports.
Anthology ID:
2022.clinicalnlp-1.5
Volume:
Proceedings of the 4th Clinical Natural Language Processing Workshop
Month:
July
Year:
2022
Address:
Seattle, WA
Editors:
Tristan Naumann, Steven Bethard, Kirk Roberts, Anna Rumshisky
Venue:
ClinicalNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
41–52
Language:
URL:
https://aclanthology.org/2022.clinicalnlp-1.5
DOI:
10.18653/v1/2022.clinicalnlp-1.5
Bibkey:
Cite (ACL):
Dabin Min, Kaeun Kim, Jong Hyuk Lee, Yisak Kim, and Chang Min Park. 2022. RRED : A Radiology Report Error Detector based on Deep Learning Framework. In Proceedings of the 4th Clinical Natural Language Processing Workshop, pages 41–52, Seattle, WA. Association for Computational Linguistics.
Cite (Informal):
RRED : A Radiology Report Error Detector based on Deep Learning Framework (Min et al., ClinicalNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.clinicalnlp-1.5.pdf
Data
CheXpert