Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data

View ORCID ProfileAlfredo Lucas, T. Campbell Arnold, View ORCID ProfileSerhat V. Okar, Chetan Vadali, Karan D. Kawatra, Zheng Ren, Quy Cao, View ORCID ProfileRussell T. Shinohara, View ORCID ProfileMatthew K. Schindler, View ORCID ProfileKathryn A. Davis, View ORCID ProfileBrian Litt, View ORCID ProfileDaniel S. Reich, View ORCID ProfileJoel M. Stein
doi: https://doi.org/10.1101/2023.12.28.23300409
Alfredo Lucas
1Perelman School of Medicine, University of Pennsylvania
2Center for Neuroengineering and Therapeutics, Departments of Bioengineering and Neurology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alfredo Lucas
  • For correspondence: alfredo.lucas{at}pennmedicine.upenn.edu
T. Campbell Arnold
2Center for Neuroengineering and Therapeutics, Departments of Bioengineering and Neurology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Serhat V. Okar
3National Institute of Neurological Disorders and Stroke, National Institutes of Health
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Serhat V. Okar
Chetan Vadali
2Center for Neuroengineering and Therapeutics, Departments of Bioengineering and Neurology, University of Pennsylvania
4Department of Radiology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karan D. Kawatra
3National Institute of Neurological Disorders and Stroke, National Institutes of Health
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zheng Ren
6Penn Statistics in Imaging and Visualization Center, Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Quy Cao
6Penn Statistics in Imaging and Visualization Center, Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Russell T. Shinohara
6Penn Statistics in Imaging and Visualization Center, Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania
7Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Russell T. Shinohara
Matthew K. Schindler
1Perelman School of Medicine, University of Pennsylvania
5Department of Neurology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Matthew K. Schindler
Kathryn A. Davis
1Perelman School of Medicine, University of Pennsylvania
2Center for Neuroengineering and Therapeutics, Departments of Bioengineering and Neurology, University of Pennsylvania
5Department of Neurology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kathryn A. Davis
Brian Litt
1Perelman School of Medicine, University of Pennsylvania
2Center for Neuroengineering and Therapeutics, Departments of Bioengineering and Neurology, University of Pennsylvania
5Department of Neurology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brian Litt
Daniel S. Reich
3National Institute of Neurological Disorders and Stroke, National Institutes of Health
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Daniel S. Reich
Joel M. Stein
1Perelman School of Medicine, University of Pennsylvania
2Center for Neuroengineering and Therapeutics, Departments of Bioengineering and Neurology, University of Pennsylvania
4Department of Radiology, University of Pennsylvania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Joel M. Stein
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Introduction Portable low-field strength (64mT) MRI scanners promise to increase access to neuroimaging for clinical and research purposes, however these devices produce lower quality images compared to high-field scanners. In this study, we developed and evaluated a deep learning architecture to generate high-field quality brain images from low-field inputs using a paired dataset of multiple sclerosis (MS) patients scanned at 64mT and 3T.

Methods A total of 49 MS patients were scanned on portable 64mT and standard 3T scanners at Penn (n=25) or the National Institutes of Health (NIH, n=24) with T1-weighted, T2-weighted and FLAIR acquisitions. Using this paired data, we developed a generative adversarial network (GAN) architecture for low- to high-field image translation (LowGAN). We then evaluated synthesized images with respect to image quality, brain morphometry, and white matter lesions.

Results Synthetic high-field images demonstrated visually superior quality compared to low-field inputs and significantly higher normalized cross-correlation (NCC) to actual high-field images for T1 (p=0.001) and FLAIR (p<0.001) contrasts. LowGAN generally outperformed the current state- of-the-art for low-field volumetrics. For example, thalamic, lateral ventricle, and total cortical volumes in LowGAN outputs did not differ significantly from 3T measurements. Synthetic outputs preserved MS lesions and captured a known inverse relationship between total lesion volume and thalamic volume.

Conclusions LowGAN generates synthetic high-field images with comparable visual and quantitative quality to actual high-field scans. Enhancing portable MRI image quality could add value and boost clinician confidence, enabling wider adoption of this technology.

Competing Interest Statement

This study received support from a research services agreement between Hyperfine, Inc. and the Trustees of the University of Pennsylvania (JMS - principal investigator). T. Campbell Arnold is an employee of Subtle Medical. This work is unrelated to Subtle Medical and was carried out during his time at the University of Pennsylvania.

Funding Statement

Dr. Brian Litt received funding from NIH DP1-NS-122038-01, NIH R01-NS-125137-01, Neil and Barbara Smit, Mirowski Family Foundation. T. Campbell Arnold was funded in part by the HHMI-NIBIB Interfaces Initiative (5T32EB009384-10) and NIH (DP1NS122038). Serhat V. Okar is supported by the National Multiple Sclerosis Society Post-Doctoral Fellowship Grant (FG-2208-40289). This study received support from a research services agreement between Hyperfine, Inc. and the Trustees of the University of Pennsylvania (JMS - principal investigator). The study was partially funded by the Intramural Research Program of NINDS/NIH.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study was approved by the institutional review board (IRB) at the University of Pennsylvania and at the National Institutes of Health, and all participants provided written informed consent.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

The algorithm used in this manuscript will be made publicly available on GitHub upon publication of the manuscript. Data used in the manuscript will be made available upon reasonable request.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted December 29, 2023.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data
Alfredo Lucas, T. Campbell Arnold, Serhat V. Okar, Chetan Vadali, Karan D. Kawatra, Zheng Ren, Quy Cao, Russell T. Shinohara, Matthew K. Schindler, Kathryn A. Davis, Brian Litt, Daniel S. Reich, Joel M. Stein
medRxiv 2023.12.28.23300409; doi: https://doi.org/10.1101/2023.12.28.23300409
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Multi-contrast high-field quality image synthesis for portable low-field MRI using generative adversarial networks and paired data
Alfredo Lucas, T. Campbell Arnold, Serhat V. Okar, Chetan Vadali, Karan D. Kawatra, Zheng Ren, Quy Cao, Russell T. Shinohara, Matthew K. Schindler, Kathryn A. Davis, Brian Litt, Daniel S. Reich, Joel M. Stein
medRxiv 2023.12.28.23300409; doi: https://doi.org/10.1101/2023.12.28.23300409

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Radiology and Imaging
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)