MedNormJ: A Benchmark Dataset for Medical Concept Normalization in Japanese Clinical Documents

Yuki Tashiro, Seiji Shimizu, Tomohiro Nishiyama, Shoko Wakamiya, Eiji Aramaki


Abstract
Medical concept normalization in clinical text is a fundamental technology for the secondary use of clinical data. However, constructing annotated resources for this task is challenging because annotation is both expertise-intensive and methodologically complex. As a result, a standard evaluation dataset for Japanese has yet to be established. In this study, we introduce a Japanese dataset for medical concept normalization, MedNormJ, which will be publicly available. The dataset consists of 397 pairs of medical expressions and their corresponding normalized disease names, manually curated from 96 medical documents, including case reports and radiology reports. Furthermore, we conduct comparative experiments using existing normalization approaches to benchmark their performance on this dataset in terms of both accuracy and computational efficiency. Through these experiments, we clarify the present performance level and identify remaining challenges specific to Japanese medical concept normalization.
Anthology ID:
2026.clinicalnlp-1.36
Volume:
Proceedings of the 8th Workshop on Clinical Natural Language Processing (Clinical NLP) @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Asma Ben Abacha, Steven Bethard, Danielle Bitterman, Tristan Naumann, Kirk Roberts
Venues:
ClinicalNLP | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
324–335
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-clinicalnlp-36
DOI:
10.63317/3tc32wmofkbm
Bibkey:
Cite (ACL):
Yuki Tashiro, Seiji Shimizu, Tomohiro Nishiyama, Shoko Wakamiya, and Eiji Aramaki. 2026. MedNormJ: A Benchmark Dataset for Medical Concept Normalization in Japanese Clinical Documents. In Proceedings of the 8th Workshop on Clinical Natural Language Processing (Clinical NLP) @ LREC 2026, pages 324–335, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
MedNormJ: A Benchmark Dataset for Medical Concept Normalization in Japanese Clinical Documents (Tashiro et al., ClinicalNLP 2026)
Copy Citation: