Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding

Zheng YuanChuanqi TanSongfang Huang

article2022ACL117 citations

Proposes a multiple synonyms matching network that incorporates UMLS terminology via a specialized attention mechanism to capture varied clinical expressions in electronic medical records, achieving state-of-the-art ICD coding performance on MIMIC-III.

Listen

Assigning standard disease classification codes to electronic medical records is essential for clinical decision support, patient tracking, and healthcare billing. However, manual coding by specialized personnel is labor-intensive, costly, and prone to human error. Existing automated systems often struggle because clinical notes contain varied medical jargon, abbreviations, and shorthand that differ markedly from standard official disease descriptions.

The article develops and evaluates a deep learning framework called the Multiple Synonyms Matching Network to demonstrate whether incorporating diverse medical synonyms improves automated disease code assignment. By linking official diagnostic codes to a comprehensive biomedical terminology repository, the method incorporates alternate phrasing directly into the classification process.

The framework processes medical discharge notes and synonymous terms using recurrent neural network encoders. It applies a multi-synonyms attention mechanism that uses each synonym to identify relevant snippets across the text, then evaluates similarities to assign appropriate diagnostic codes without relying on code-specific training parameters for rare conditions. The approach was tested on the benchmark MIMIC-III clinical database across both a full set of thousands of diagnostic codes and a focused subset of the fifty most frequent codes.

The evaluation produced several key findings. Incorporating multiple synonyms outperformed existing state-of-the-art models across standard evaluation metrics. On the full code dataset, the model improved the area under the ROC curve to 95.0% (a 2.0 percentage point gain) and achieved top precision scores of 75.2% and 59.9% across top-8 and top-15 predictions. On the top-50 code dataset, the model improved overall precision and balance, raising the macro F1 score by 1.7 percentage points to 68.3%. Analysis confirmed that performance steadily improved when expanding from a single standard description up to four or eight synonyms per code, aligning with the natural synonym density in biomedical databases.

These findings indicate that addressing linguistic variation directly in automated medical coding systems substantially enhances classification accuracy. For healthcare organizations, adopting synonym-aware models can reduce manual review workloads, lower administrative billing costs, and minimize revenue risks from coding errors. The system also mitigates data scarcity issues for rare diseases by using code-independent similarity scoring.

Healthcare technology leaders should consider integrating synonym enrichment into clinical documentation and automated coding pipelines. When implementing such models, organizations must balance computing resources, as memory usage scales linearly with the number of synonyms utilized. While the framework demonstrates strong benchmark performance, potential adopters should exercise caution regarding performance volatility on extremely rare disease codes in the long tail and should validate the system on diverse institutional datasets before full-scale deployment.

No sufficiently relevant recommendations were found.

Cover for Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding

Abstract

Automatic ICD coding is defined as assigning disease codes to electronic medical records (EMRs). Existing methods usually apply label attention with code representations to match related text snippets. Unlike these works that model the label with the code hierarchy or description, we argue that the code synonyms can provide more comprehensive knowledge based on the observation that the code expressions in EMRs vary from their descriptions in ICD. By aligning codes to concepts in UMLS, we collect synonyms of every code. Then, we propose a multiple synonyms matching network to leverage synonyms for better code representation learning, and finally help the code classification. Experiments on the MIMIC-III dataset show that our proposed method outperforms previous state-of-the-art methods.

Table of Contents

  • 1 Introduction
  • 2 Approach
  • 2.1 Code Synonyms
  • 2.2 Encoding
  • 2.3 Multi-synonyms Attention
  • 2.4 Classification
  • 2.5 Training
  • 3 Experiments
  • 3.1 Dataset
  • 3.2 Implementation Details
  • 3.3 Baselines
  • 3.4 Main Results
  • 3.5 Discussion
  • 3.6 Memory Complexity
  • 4 Related Work
  • 5 Conclusions
  • Acknowledgements
  • References

Knowls

  1. Knowl 1 — Extraction blocked: source document text unavailable

    limitation

    No knowl could be extracted from this paper: the attached file (8c5fdfb3-4284-4c17-ac76-8cdb5a64c647.pdf) was supplied without accessible text content, so the paper's methods, theory, experiments, and results could not be read or verified. Any knowl generated without access to the source would violate the fidelity requirement that no knowledge be added from outside the paper. To obtain the knowls, the document's text content must be provided.

Coverage note — No substantial contributed material was extracted because the attached PDF was provided without readable text content; every part of the paper's contribution was therefore deliberately omitted, and the single knowl records this extraction failure rather than any claim from the paper.

Citation

MLA
Yuan, Z., et al. “Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding”. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022, pp. 808–14, https://doi.org/10.18653/v1/2022.acl-short.91.
APA
Yuan, Z., Tan, C., & Huang, S. (2022). Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 808–814. https://doi.org/10.18653/v1/2022.acl-short.91
Chicago
Yuan, Z., C. Tan, and S. Huang. 2022. “Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding”. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 808–14. https://doi.org/10.18653/v1/2022.acl-short.91.
Harvard
Yuan, Z., Tan, C. and Huang, S. (2022) “Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding”, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, pp. 808–814. Available at: https://doi.org/10.18653/v1/2022.acl-short.91.
Vancouver
1. Yuan Z, Tan C, Huang S (2022) Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, pp 808–814

BibTeX

@inproceedings{yuan-etal-2022-code,
    title = "Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic {ICD} Coding",
    author = "Yuan, Zheng  and
      Tan, Chuanqi  and
      Huang, Songfang",
    editor = "Muresan, Smaranda  and
      Nakov, Preslav  and
      Villavicencio, Aline",
    booktitle = "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)",
    month = may,
    year = "2022",
    address = "Dublin, Ireland",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.acl-short.91/",
    doi = "10.18653/v1/2022.acl-short.91",
    pages = "808--814"
}
Metadata:ACL Anthology

Source Code

This paper has an official code repository available. Click below to access the source code.

View Repository

Access the Paper

This paper is available from its original source. Click below to access the PDF.

Open PDF
License: https://creativecommons.org/licenses/by/4.0/