Modelling Temporal Document Sequences for Clinical ICD Coding

Boon Liang Clarence Ng, Diogo Santos, Marek Rei


Abstract
Past studies on the ICD coding problem focus on predicting clinical codes primarily based on the discharge summary. This covers only a small fraction of the notes generated during each hospital stay and leaves potential for improving performance by analysing all the available clinical notes. We propose a hierarchical transformer architecture that uses text across the entire sequence of clinical notes in each hospital stay for ICD coding, and incorporates embeddings for text metadata such as their position, time, and type of note. While using all clinical notes increases the quantity of data substantially, superconvergence can be used to reduce training costs. We evaluate the model on the MIMIC-III dataset. Our model exceeds the prior state-of-the-art when using only discharge summaries as input, and achieves further performance improvements when all clinical notes are used as input.
Anthology ID:
2023.eacl-main.120
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1640–1649
Language:
URL:
https://aclanthology.org/2023.eacl-main.120
DOI:
10.18653/v1/2023.eacl-main.120
Bibkey:
Cite (ACL):
Boon Liang Clarence Ng, Diogo Santos, and Marek Rei. 2023. Modelling Temporal Document Sequences for Clinical ICD Coding. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1640–1649, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Modelling Temporal Document Sequences for Clinical ICD Coding (Ng et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.120.pdf
Software:
 2023.eacl-main.120.software.zip
Video:
 https://aclanthology.org/2023.eacl-main.120.mp4