Abstract
Introduction Structural neuroimaging analyses require ‘research quality’ images, acquired with costly MRI acquisitions. Isotropic (3D) T1 images are desirable for quantitative analyses, however a routine compromise in the clinical setting is to acquire anisotropic (2D) analogues for qualitative visual inspection. Machine learning-based software have shown promise in addressing some of the limitations of 2D scans in research applications, yet their efficacy in quantitative research is not well understood. To evaluate the applicability of image preprocessing methods, morphometry in idiopathic generalised epilepsy (IGE)—in which, pathology-related abnormalities of the subcortical structures have been reproducibly demonstrated—was investigated first in 3D scans, then in 2D scans, resampled images, and synthesised images.
Methods 2D and 3D T1 MRI were acquired during the same scanning session from 31 individuals (males = 14, mean age = 32.16) undergoing evaluation for IGE at the Walton Centre NHS Foundation Trust, Liverpool, as well as 39 healthy age- and sex-matched controls (males = 16, mean age = 32.13). The DL+DiReCT pipeline was used to provide segmentations of the 2D images, and estimates of regional volume and thickness. The 2D scans were also resampled into isotropic images using NiBabel, and preprocessed into synthetic isotropic images using SynthSR. For the 3D scans, untransformed 2D scans, resampled images, and synthesised images, FreeSurfer 7.2.0 was used to create parcellations of 178 anatomical regions (equivalent to the 178 parcellations provided as part of the DL+DiReCT pipeline), defined by the aseg and Destrieux atlases, and FSL FIRST was used to segment subcortical surface shapes. Spatial correspondence and intraclass correlations between the morphometrics of the five parcellations were first determined, then subcortical surface shape abnormalities associated with IGE were identified by comparing the FSL FIRST outputs of patients with controls.
Results When standardised to the metrics derived from the 3D scans, cortical volume and thickness estimates trended lower for the untransformed 2D, DL+DiReCT, resampled, and SynthSR images, whereas subcortical volume estimates did not differ. Dice coefficients revealed a low spatial similarity between the cortices of the 3D scans and the other images overall, which was higher in the subcortical structures. Intraclass correlation coefficients reiterated this disparity, with estimates of thickness being less similar than those of volume, and DL+DiReCT estimates trending less similar than the other images types. For the people with epilepsy, the 3D scans showed significant surface deflations across various subcortical structures when compared to healthy controls. Analysis of the untransformed 2D scans enabled the detection of a subset of subcortical abnormalities, whereas analyses of the resampled and synthetic images attenuated almost all significance.
Conclusions Generalised image synthesis methods do not currently attenuate partial volume effects resulting from low through plane resolution in anisotropic MRI scans, instead quantitative analyses using 2D images should be interpreted with caution, and researchers should consider the potential implications of preprocessing.
Key Points
Estimates of cortical and subcortical morphometry/volumetry from synthetic images were not closer to the ground truth than estimates from 2D scans.
Spatial correspondence of regional parcellations to their ground truth analogue was not higher in synthetic images than 2D scans.
Priors in synthetic image creation models may render them insensitive to subtle biomarkers.
Resampling and generalised synthesis are not currently replacements for research quality acquisitions in quantitative MRI research.
The results of studies using synthetic iamges should be interpreted in a separate context to those using untransformed data.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
SSK acknowledges support from the UK Medical Research Council (Grant Number MR/S00355X/1).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
North West - Liverpool Central Research Ethics Committee gave ethical approval/favourable opinion for this work. REC reference 14/NW/0332).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
Christophe de Bézenac <cedb{at}liverpool.ac.uk>, Kumar Das <Kumar.Das{at}liverpool.ac.uk>, Shubhabrata Biswas <Shubhabrata.Biswas{at}nhs.net>, Anthony Marson <A.G.Marson{at}liverpool.ac.uk>, Simon S. Keller <Simon.Keller{at}liverpool.ac.uk>
Ethics and Integrity Nothing to declare.
Data Availability
Data available on request from the authors. Code freely available on GitHub.
Abbreviations
- ML
- Machine Learning
- qMRI
- Quantitative Magnetic Resonance Imaging
- PVEs
- Partial-volume Effects
- DL
- Deep Learning
- CNN
- Convolutional Neural Network
- GAN
- Generative Adversarial Network
- PWE
- People With Epilepsy
- IGE
- Idiopathic Generalised Epilepsies
- HC
- Healthy Controls
- rT1
- Resampled isometric T1 images
- sT1
- SynthSR isometric T1 images
- dT1
- DL+DiReCT Outputs
- ANTs
- Advanced Normalization Tools
- FSL
- FMRIB Software Library
- ICCs
- Intraclass Correlation Coefficients