Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Contrastive Self-supervised Learning for Neurodegenerative Disorder Classification

View ORCID ProfileVadym Gryshchuk, View ORCID ProfileDevesh Singh, View ORCID ProfileStefan Teipel, View ORCID ProfileMartin Dyrba, ADNI, AIBL, FTLDNI study groups
doi: https://doi.org/10.1101/2024.07.03.24309882
Vadym Gryshchuk
aGerman Center for Neurodegenerative Diseases (DZNE), Rostock, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Vadym Gryshchuk
Devesh Singh
aGerman Center for Neurodegenerative Diseases (DZNE), Rostock, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Devesh Singh
  • For correspondence: devesh.singh{at}dzne.de martin.dyrba{at}dzne.de
Stefan Teipel
aGerman Center for Neurodegenerative Diseases (DZNE), Rostock, Germany
bDepartment of Psychosomatic Medicine, Rostock University Medical Center, Rostock, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Stefan Teipel
Martin Dyrba
aGerman Center for Neurodegenerative Diseases (DZNE), Rostock, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Martin Dyrba
  • For correspondence: devesh.singh{at}dzne.de martin.dyrba{at}dzne.de
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Neurodegenerative diseases such as Alzheimer’s disease (AD) or frontotemporal lobar degeneration (FTLD) involve specific loss of brain volume, detectable in vivo using T1-weighted MRI scans. Supervised machine learning approaches classifying neurodegenerative diseases require diagnostic-labels for each sample. However, it can be difficult to obtain expert labels for a large amount of data. Self-supervised learning (SSL) offers an alternative for training machine learning models without data-labels. We investigated if the SSL models can applied to distinguish between different neurodegenerative disorders in an interpretable manner. Our method comprises a feature extractor and a downstream classification head. A deep convolutional neural network trained in a contrastive self-supervised way serves as the feature extractor, learning latent representation, while the classifier head is a single-layer perceptron. We used N=2694 T1-weighted MRI scans from four data cohorts: two ADNI datasets, AIBL and FTLDNI, including cognitively normal controls (CN), cases with prodromal and clinical AD, as well as FTLD cases differentiated into its sub-types. Our results showed that the feature extractor trained in a self-supervised way provides generalizable and robust representations for the downstream classification. For AD vs. CN, our model achieves 82% balanced accuracy on the test subset and 80% on an independent holdout dataset. Similarly, the Behavioral variant of frontotemporal dementia (BV) vs. CN model attains an 88% balanced accuracy on the test subset. The average feature attribution heatmaps obtained by the Integrated Gradient method highlighted hallmark regions, i.e., temporal gray matter atrophy for AD, and insular atrophy for BV. In conclusion, our models perform comparably to state-of-the-art supervised deep learning approaches. This suggests that the SSL methodology can successfully make use of unannotated neuroimaging datasets as training data while remaining robust and interpretable.

Competing Interest Statement

S.T. served as member of advisory boards of Lilly, Eisai, and Biogen, and is member of the independent data safety and monitoring board of the study ENVISION (Biogen). V.G., D.S. and M.D. declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Funding Statement

This study was supported by the German Research Foundation (Deutsche Forschungsgemeinschaft, DFG) under grant DY151/2-1, project ID 454834942.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The data used for this study is publicly available and can be obtained from the respective repositories: Alzheimer's Disease Neuroimaging Initiative (ADNI) http://adni.loni.usc.edu/data-samples/access-data, Australian Imaging Biomarkers and Lifestyle flagship study of ageing (AIBL) https://aibl.csiro.au, and Frontotemporal Lobar Degeneration Neuroimaging Initiative (FTLDNI) https://memory.ucsf.edu/research-trials/research/allftd. Data collection of the respective neuroimaging initiatives was approved by the internal review boards of each of the participating study sites. See https://adni.loni.usc.edu and https://aibl.csiro.au for details. All initiatives met common ethical standards in the collection of the data such as the Declaration of Helsinki. Analysis of the data was approved by the internal review board of the Rostock University Medical Center, reference number A 2020-0182.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • ↵** More detailed information on the consortia is available in the acknowledgement section.

Data Availability

The data used for this study is publicly available and can be obtained from the respective repositories: Alzheimer's Disease Neuroimaging Initiative (ADNI) http://adni.loni.usc.edu/data-samples/access-data, Australian Imaging Biomarkers and Lifestyle flagship study of ageing (AIBL) https://aibl.csiro.au, and Frontotemporal Lobar Degeneration Neuroimaging Initiative (FTLDNI) https://memory.ucsf.edu/research-trials/research/allftd.

http://adni.loni.usc.edu/data-samples/access-data

https://aibl.csiro.au

https://memory.ucsf.edu/research-trials/research/allftd

  • Abbreviations

    AD
    Alzheimer’s disease
    ADNI
    Alzheimer’s Disease Neuroimaging Initiative
    AIBL
    Australian Imaging, Biomarker & Lifestyle Flagship Study of Ageing
    BN
    Batch normalisation
    BV
    behavioral variant of frontotemporal dementia
    CN
    Cognitively normal participants
    CNN
    Convolutional neural network
    ConvNeXT
    A highly optimized CNN model architecture recently introduced by Liu et al. (2022b)
    DZNE
    Deutsches Zentrum für Neurodegenerative Erkrankungen (German Center for Neurodegenerative Diseases)
    FTLD
    Frontotemporal lobar degeneration
    FTLDNI
    Frontotemporal Lobar Degeneration Neuroimaging Initiative
    GELU
    Gaussian error linear units
    Grad-CAM
    Gradient-weighted class activation mapping
    IG
    Integrated gradients
    InfoNCE
    A form a contrastive loss metric, where NCE stands for Noise-Contrastive Estimation
    LN
    Layer-wise normalization
    LRP
    Layer-wise relevance propagation
    MCC
    Matthews correlation coefficient
    MCI
    Mild cognitive impairment
    MNI
    Montreal Neurological Institute
    MRI
    Magnetic resonance imaging
    NNCLR
    Nearest-Neighbor Contrastive Learning
    PNFA
    Progressive non-fluent aphasia
    SL
    Supervised learning
    SSL
    Self-supervised learning
    SV
    semantic variant of frontotemporal dementia
    ViT
    Vision Transformers
    XAI
    Explainable artificial intelligence
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
    Back to top
    PreviousNext
    Posted July 04, 2024.
    Download PDF
    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Contrastive Self-supervised Learning for Neurodegenerative Disorder Classification
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Contrastive Self-supervised Learning for Neurodegenerative Disorder Classification
    Vadym Gryshchuk, Devesh Singh, Stefan Teipel, Martin Dyrba, ADNI, AIBL, FTLDNI study groups
    medRxiv 2024.07.03.24309882; doi: https://doi.org/10.1101/2024.07.03.24309882
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    Contrastive Self-supervised Learning for Neurodegenerative Disorder Classification
    Vadym Gryshchuk, Devesh Singh, Stefan Teipel, Martin Dyrba, ADNI, AIBL, FTLDNI study groups
    medRxiv 2024.07.03.24309882; doi: https://doi.org/10.1101/2024.07.03.24309882

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Radiology and Imaging
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)