Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Automated differentiation of malignant and benign primary solid liver lesions on MRI: an externally validated radiomics model

View ORCID ProfileMartijn P.A. Starmans, View ORCID ProfileRazvan L. Miclea, View ORCID ProfileValerie Vilgrain, View ORCID ProfileMaxime Ronot, View ORCID ProfileYvonne Purcell, View ORCID ProfileJef Verbeek, View ORCID ProfileWiro J. Niessen, View ORCID ProfileJan N.M. Ijzermans, Rob A. de Man, View ORCID ProfileMichail Doukas, View ORCID ProfileStefan Klein, View ORCID ProfileMaarten G. Thomeer
doi: https://doi.org/10.1101/2021.08.10.21261827
Martijn P.A. Starmans
1Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
MSc
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Martijn P.A. Starmans
  • For correspondence: m.starmans{at}erasmusmc.nl
Razvan L. Miclea
2Department of Radiology and Nuclear Medicine, Maastricht UMC+, Maastricht, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Razvan L. Miclea
Valerie Vilgrain
3Université de Paris, INSERM U 1149, CRI, Paris, France
4Département de Radiologie, Hôpital Beaujon, APHP.Nord, Clichy, France
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Valerie Vilgrain
Maxime Ronot
3Université de Paris, INSERM U 1149, CRI, Paris, France
4Département de Radiologie, Hôpital Beaujon, APHP.Nord, Clichy, France
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maxime Ronot
Yvonne Purcell
5Department of Radiology, Hôpital Fondation Rothschild, Paris, France
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Yvonne Purcell
Jef Verbeek
6Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium
7Department of Gastroenterology and Hepatology, Maastricht UMC+, Maastricht, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jef Verbeek
Wiro J. Niessen
1Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
8Faculty of Applied Sciences, Delft University of Technology, the Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Wiro J. Niessen
Jan N.M. Ijzermans
9Department of Surgery, Erasmus MC, Rotterdam, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jan N.M. Ijzermans
Rob A. de Man
10Department of Gastroenterology & Hepatology, Erasmus MC, Rotterdam, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michail Doukas
11Department of Pathology, Erasmus MC, Rotterdam, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michail Doukas
Stefan Klein
1Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Stefan Klein
Maarten G. Thomeer
1Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maarten G. Thomeer
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background & Aims Distinguishing malignant from benign primary solid liver lesions is highly important for treatment planning. However, diagnosis on radiological imaging is challenging. In this study, we developed a radiomics model based on magnetic resonance imaging (MRI) to distinguish the most common malignant and benign primary solid liver lesions, and externally validated the model in two centers.

Approach & Results Datasets were retrospectively collected from three tertiary referral centers (A, B and C) including data from affiliated hospitals sent for revision. Patients with malignant (hepatocellular carcinoma and intrahepatic cholangiocarcinoma) and benign (hepatocellular adenoma and focal nodular hyperplasia) lesions were included. For each patient, only a T2-weighted MRI was included. A radiomics model was developed on dataset A using a combination of machine learning approaches, and internally evaluated on dataset A through cross-validation. Next, the model was externally validated on datasets B and C, and compared to scoring by two experienced abdominal radiologists on dataset C. In the resulting dataset, in total, 486 patients were included (A: 187, B: 98 and C: 201). Despite substantial MRI acquisition heterogeneity, the radiomics model developed on dataset A had a mean area under the receiver operating characteristic curve (AUC) of 0.78 in the internal validation on dataset A, and a similar AUC in the external validations (B: 0.74, C: 0.76). In dataset C, the two radiologists showed moderate agreement (Cohen’s κ: 0.61) and achieved AUCs of 0.86 and 0.82, respectively.

Conclusions Our radiomics model using T2-weighted MRI only can non-invasively distinguish malignant from benign primary solid liver lesions. External validation indicated that our model is generalizable despite substantial differences in the acquisition protocols.

Competing Interest Statement

Wiro Niessen is founder, scientific lead, and shareholder of Quantib BV. The other authors do not declare any conflicts of interest.

Funding Statement

Martijn Starmans acknowledges funding from the research program STRaTeGy (project number 14929-14930), which is (partly) financed by the Netherlands Organisation for Scientific Research (NWO). This work was partially carried out on the Dutch national e-infrastructure with the support of SURF Cooperative.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Approval for this study by the institutional review boards of Erasmus MC (Rotterdam, the Netherlands) (MEC-2017-1035), Maastricht UMC+ (Maastricht, the Netherlands) (METC 2018-0742), and Hopital Beaujon (Paris, France) (Nr. 2018-002) was obtained. Informed consent was waived due to the use of retrospective, anonymized data. The study protocol conformed to the ethical guidelines of the 1975 Declaration of Helsinki.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Mail: m.starmans{at}erasmusmc.nl; razvan.miclea{at}mumc.nl; valerie.vilgrain{at}aphp.fr; maxime.ronot{at}aphp.fr; yvonne.purcell{at}gmail.com; jef.verbeek{at}uzleuven.be; w.niessen{at}erasmusmc.nl; j.ijzermans{at}erasmusmc.nl; r.deman{at}erasmusmc.nl; m.doukas{at}erasmusmc.nl; s.klein{at}erasmusmc.nl; m.thomeer{at}erasmusmc.nl

  • Data availability statement: Imaging and clinical research data are not available at this time. Programming code is available on Zenodo at DOI https://doi.org/10.5281/zenodo.5175705.

  • Conflict of interest statement: Wiro Niessen is founder, scientific lead, and shareholder of Quantib BV. The other authors do not declare any conflicts of interest.

  • Financial support statement: No funding sources were involved in the study design, collection, analysis, and interpretation of data, writing the report, nor the decision to submit the article for publication.

Data Availability

Imaging and clinical research data are not available at this time. Programming code is available on Zenodo at DOI https://doi.org/10.5281/zenodo.5175705.

https://github.com/MStarmans91/LiverRadiomics

  • Abbreviations

    AUC
    area under the curve
    ADC
    apparent diffusion coefficient
    DSC
    Dice similarity coefficient
    EASL
    European association for the study of the liver
    FNH
    focal nodular hyperplasia
    HCA
    hepatocellular adenoma
    HCC
    hepatocellular carcinoma
    iCCA
    intrahepatic cholangiocarcinoma
    MRI
    magnetic resonance imaging
    ROC
    receiver operating characteristic
    WORC
    workflow for optimal radiomics classification
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
    Back to top
    PreviousNext
    Posted August 10, 2021.
    Download PDF

    Supplementary Material

    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Automated differentiation of malignant and benign primary solid liver lesions on MRI: an externally validated radiomics model
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Automated differentiation of malignant and benign primary solid liver lesions on MRI: an externally validated radiomics model
    Martijn P.A. Starmans, Razvan L. Miclea, Valerie Vilgrain, Maxime Ronot, Yvonne Purcell, Jef Verbeek, Wiro J. Niessen, Jan N.M. Ijzermans, Rob A. de Man, Michail Doukas, Stefan Klein, Maarten G. Thomeer
    medRxiv 2021.08.10.21261827; doi: https://doi.org/10.1101/2021.08.10.21261827
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    Automated differentiation of malignant and benign primary solid liver lesions on MRI: an externally validated radiomics model
    Martijn P.A. Starmans, Razvan L. Miclea, Valerie Vilgrain, Maxime Ronot, Yvonne Purcell, Jef Verbeek, Wiro J. Niessen, Jan N.M. Ijzermans, Rob A. de Man, Michail Doukas, Stefan Klein, Maarten G. Thomeer
    medRxiv 2021.08.10.21261827; doi: https://doi.org/10.1101/2021.08.10.21261827

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Radiology and Imaging
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)