AnEMIC: A Framework for Benchmarking ICD Coding Models

Juyong Kim, Abheesht Sharma, Suhas Shanbhogue, Jeremy Weiss, Pradeep Ravikumar


Abstract
Diagnostic coding, or ICD coding, is the task of assigning diagnosis codes defined by the ICD (International Classification of Diseases) standard to patient visits based on clinical notes. The current process of manual ICD coding is time-consuming and often error-prone, which suggests the need for automatic ICD coding. However, despite the long history of automatic ICD coding, there have been no standardized frameworks for benchmarking ICD coding models. We open-source an easy-to-use tool named AnEMIC, which provides a streamlined pipeline for preprocessing, training, and evaluating for automatic ICD coding. We correct errors in preprocessing by existing works, and provide key models and weights trained on the correctly preprocessed datasets. We also provide an interactive demo performing real-time inference from custom inputs, and visualizations drawn from explainable AI to analyze the models. We hope the framework helps move the research of ICD coding forward and helps professionals explore the potential of ICD coding. The framework and the associated code are available here.
Anthology ID:
2022.emnlp-demos.11
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
December
Year:
2022
Address:
Abu Dhabi, UAE
Editors:
Wanxiang Che, Ekaterina Shutova
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
109–120
Language:
URL:
https://aclanthology.org/2022.emnlp-demos.11
DOI:
10.18653/v1/2022.emnlp-demos.11
Bibkey:
Cite (ACL):
Juyong Kim, Abheesht Sharma, Suhas Shanbhogue, Jeremy Weiss, and Pradeep Ravikumar. 2022. AnEMIC: A Framework for Benchmarking ICD Coding Models. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 109–120, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
AnEMIC: A Framework for Benchmarking ICD Coding Models (Kim et al., EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-demos.11.pdf