Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Deep learning-based automatic classification of ischemic stroke subtype using diffusion-weighted images

View ORCID ProfileWi-Sun Ryu, Dawid Schellingerhout, Hoyoun Lee, View ORCID ProfileKeon-Joo Lee, Chi Kyung Kim, Beom Joon Kim, View ORCID ProfileJong-Won Chung, View ORCID ProfileJae-Sung Lim, Joon-Tae Kim, Dae-Hyun Kim, Jae-Kwan Cha, View ORCID ProfileLeonard Sunwoo, View ORCID ProfileDongmin Kim, Sang-Il Suh, View ORCID ProfileOh Young Bang, View ORCID ProfileHee-Joon Bae, Dong-Eog Kim
doi: https://doi.org/10.1101/2024.02.02.24302247
Wi-Sun Ryu
1Department of Neurology, Dongguk University Ilsan Hospital, Goyang, Republic of Korea
2Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Wi-Sun Ryu
Dawid Schellingerhout
3Department of Neuroradiology and Imaging Physics, The University of Texas M.D. Anderson Cancer Center, Houston, USA
MBChB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hoyoun Lee
2Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Keon-Joo Lee
4Department of Neurology, Korea University Guro Hospital, Seoul, Republic of Korea
MD, MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Keon-Joo Lee
Chi Kyung Kim
4Department of Neurology, Korea University Guro Hospital, Seoul, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Beom Joon Kim
5Department of Neurology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jong-Won Chung
6Department of Neurology, Samsung Medical Center, Sungkyunkwan University, Seoul, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jong-Won Chung
Jae-Sung Lim
7Department of Neurology, Asan Medical Center, Seoul, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jae-Sung Lim
Joon-Tae Kim
8Department of Neurology, Chonnam National University Hospital, Gwangju, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dae-Hyun Kim
9Department of Neurology, Dong-A University Hospital, Busan, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jae-Kwan Cha
9Department of Neurology, Dong-A University Hospital, Busan, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leonard Sunwoo
10Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Leonard Sunwoo
Dongmin Kim
2Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Dongmin Kim
Sang-Il Suh
11Department of Radiology, Korea University Guro Hospital, Korea University College of Medicine, Seoul, South Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Oh Young Bang
6Department of Neurology, Samsung Medical Center, Sungkyunkwan University, Seoul, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Oh Young Bang
Hee-Joon Bae
5Department of Neurology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hee-Joon Bae
Dong-Eog Kim
1Department of Neurology, Dongguk University Ilsan Hospital, Goyang, Republic of Korea
12National Priority Research Center for Stroke, Goyang, Republic of Korea
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: kdongeog{at}duih.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

BACKGROUND Accurate classification of ischemic stroke subtype is important for effective secondary prevention of stroke. We used diffusion-weighted imaging (DWI) and atrial fibrillation (AF) data to train a deep learning algorithm to classify stroke subtype.

METHODS Model training, validation, and internal testing were done in 2,988 patients with acute ischemic stroke from three stroke centers by using U-net for infarct segmentation and EfficientNetV2 for stroke subtype classification. Experienced vascular neurologists (n=5) determined stroke subtypes for external test datasets, while establishing a consensus for clinical trial datasets using the TOAST classification. Infarcts on DW images were automatically segmented using an artificial intelligence solution that we recently developed, and their masks were fed as inputs to a deep learning algorithm (DWI-only algorithm). Subsequently, another model was trained, with the presence or absence of AF included in the training as a categorical variable (DWI+AF algorithm). These models were tested: a) internally against the opinion of the labeling experts, b) against fresh external DWI data, and also c) against clinical trial DWI data acquired at a later date.

RESULTS In the training-and-validation datasets, the mean age was 68.0±12.5 (61.1% male). In internal testing, compared with the experts, the DWI-only algorithm and the DWI+AF algorithm respectively achieved moderate (65.3%) and near-strong (79.1%) agreement. In external testing, both algorithms again showed good agreements (59.3-60.7% and 73.7-74.0%, respectively). In the clinical trial dataset, compared with the expert consensus, percentage agreements and Cohen’s kappa were respectively 58.1% and 0.34 for the DWI-only algorithm vs. 72.9% and 0.57 for the DWI+AF algorithm. The corresponding values between experts were comparable (76.0% and 0.61) to the DWI+AF algorithm.

CONCLUSIONS Our deep learning algorithm trained on a large dataset of DWI (both with or without AF information) was able to classify ischemic stroke subtypes as accurately as a consensus of stroke experts.

Competing Interest Statement

Wi-Sun Ryu, Hoyoun Lee, and Dongmin Kim are employees of JLK Inc.

Funding Statement

This study was supported by the Multiministry Grant for Medical Device Development (KMDF_PR_20200901_0098), the National Priority Research Center Program Grant (NRF-2021R1A6A1A03038865), and the Basic Science Research Program Grant (NRF-2020R1A2C3008295) of National Research Foundation, funded by the Korean government.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The institutional review board of Dongguk University Hospital approved the study protocol (IRB No. 2017-09-017), and patients or their legal proxies provided a written informed consent.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

Data generated or analyzed during the study are available from the corresponding author by request.

  • Non-standard Abbreviations and Acronyms

    DWI
    diffusion-weighted
    MRI LAA
    large artery atherosclerosis
    CE
    cardioembolism
    SVO
    small vessel occlusion
    TOAST
    The Trial of Org10172 in Acute Stroke
    ECG
    electrocardiography
    AF
    atrial fibrillation
    AI
    artificial intelligence
    NIHSS
    National Institute of Health Stroke Scale
    ESUS
    Embolic Stroke with Undetermined Source
    RCT
    randomized clinical trial
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
    Back to top
    PreviousNext
    Posted February 04, 2024.
    Download PDF
    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Deep learning-based automatic classification of ischemic stroke subtype using diffusion-weighted images
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Deep learning-based automatic classification of ischemic stroke subtype using diffusion-weighted images
    Wi-Sun Ryu, Dawid Schellingerhout, Hoyoun Lee, Keon-Joo Lee, Chi Kyung Kim, Beom Joon Kim, Jong-Won Chung, Jae-Sung Lim, Joon-Tae Kim, Dae-Hyun Kim, Jae-Kwan Cha, Leonard Sunwoo, Dongmin Kim, Sang-Il Suh, Oh Young Bang, Hee-Joon Bae, Dong-Eog Kim
    medRxiv 2024.02.02.24302247; doi: https://doi.org/10.1101/2024.02.02.24302247
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    Deep learning-based automatic classification of ischemic stroke subtype using diffusion-weighted images
    Wi-Sun Ryu, Dawid Schellingerhout, Hoyoun Lee, Keon-Joo Lee, Chi Kyung Kim, Beom Joon Kim, Jong-Won Chung, Jae-Sung Lim, Joon-Tae Kim, Dae-Hyun Kim, Jae-Kwan Cha, Leonard Sunwoo, Dongmin Kim, Sang-Il Suh, Oh Young Bang, Hee-Joon Bae, Dong-Eog Kim
    medRxiv 2024.02.02.24302247; doi: https://doi.org/10.1101/2024.02.02.24302247

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Neurology
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)