Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Detecting radiographic sacroiliitis using deep learning with expert-level accuracy in axial spondyloarthritis

Keno K. Bressem, View ORCID ProfileJanis L. Vahldiek, Lisa C. Adams, Stefan M. Niehues, Hildrun Haibel, Valeria Rios Rodriguez, Murat Torgutalp, Mikhail Protopopov, Fabian Proft, Judith Rademacher, Joachim Sieper, Martin Rudwaleit, Bernd Hamm, Marcus R. Makowski, Kay Geert A. Hermann, Denis Poddubnyy
doi: https://doi.org/10.1101/2020.05.19.20105304
Keno K. Bressem
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
3Berlin Institute of Health, BIH, Anna-Louisa-Karsch-Straße 2, 10178 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Janis L. Vahldiek
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Janis L. Vahldiek
  • For correspondence: janis.vahldiek{at}charite.de
Lisa C. Adams
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
3Berlin Institute of Health, BIH, Anna-Louisa-Karsch-Straße 2, 10178 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stefan M. Niehues
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hildrun Haibel
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Valeria Rios Rodriguez
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Murat Torgutalp
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mikhail Protopopov
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fabian Proft
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Judith Rademacher
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
3Berlin Institute of Health, BIH, Anna-Louisa-Karsch-Straße 2, 10178 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joachim Sieper
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martin Rudwaleit
4Klinikum Bielefeld Rosenhöhe, Department of Internal Medicine and Rheumatology, An der Rosenhöhe 27, 33647 Bielefeld, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bernd Hamm
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marcus R. Makowski
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kay Geert A. Hermann
1Charité Universitätsmedizin Berlin, Department of Radiology, Hindenburgdamm 30, 12203 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Denis Poddubnyy
2Charité Universitätsmedizin Berlin, Department of Gastroenterology, Infectious Diseases and Rheumatology, Hindenburgdamm 30, 12203 Berlin, Germany
5German Rheumatism Research Centre, Department of Epidemiology, Charitéplatz 1, 10117 Berlin, Germany
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Conventional radiographs of sacroiliac joints from two independent cohorts of patients with axial spondyloarthritis (axSpA) were used to develop and validate an artificial neural network for the detection of definite radiographic sacroiliitis as a manifestation of the disease. The first cohort consisting of 1669 radiographs labelled by three experts was used for training. From the second cohort 100 radiographs labelled by two experts were randomly selected for the test dataset. The neural network achieved an excellent performance in detection of definite radiographic sacroiliitis with an area under the receiver operating characteristics curve of 0.97 and 0.96 for the validation and test datasets, respectively. Sensitivity and specificity for the cut-off weighting both measurements equally were 0.90 and 0.93 for the validation and 0.87 and 0.97 for the test set. The Cohen’s kappa between the neural network and the reference judgements were 0.80 for both validation and test sets, and the absolute agreement on the classification yielded 91% and 90%, respectively.

Competing Interest Statement

K.-K.B., L.A., J.R., M.T. and M.M. have nothing to disclose. J.L.V reports non-financial support from Bayer, non-financial support from Guerbet, non-financial support from Medtronic, personal fees and non-financial support from Merit Medical, outside the submitted work S.M.N. reports grants from Deutsche Forschungsgemeinschaft, personal fees from Bracco Imaging, personal fees from Canon Medical Systems, personal fees from Guerbet, personal fees from Teleflex Medical GmbH, personal fees from Bayer Vital GmbH, outside the submitted work. H.H. reports personal fees from Pfizer, personal fees from Janssen, personal fees from Novartis, personal fees from Roche, personal fees from MSD, outside the submitted work. V.R.R. reports personal fees from Abbvie, personal fees from Novartis, outside the submitted work. M.P. reports personal fees from Novartis, personal fees from AbbVie, outside the submitted work. F.P. reports personal fees from AbbVie, personal fees from AMGEN, personal fees from BMS, personal fees from Celgene, from MSD, grants and personal fees from Novartis, personal fees from Pfizer, from Roche, personal fees from UCB, outside the submitted work. J.S. reports grants from AbbVie, during the conduct of the study; personal fees from AbbVie, personal fees from Novartis, personal fees from Pfizer, personal fees from Roche, personal fees from UCB, personal fees from Boehringer Ingelheim, personal fees from Janssen, personal fees from Merk, outside the submitted work. M.R. received honoraria and/or consulting fees from AbbVie, BMS, Celgene, Janssen, Eli Lilly, MSD, Novartis, Pfizer, Roche, UCB Pharma. B.H. reports grants from Abbot, grants from Actelion Pharmaceuticals, grants from Bayer Schering Pharma, grants from Bayer Vital, grants from BRACCO Group, grants from Bristol-Myers Squibb, grants from Charite Research Organisation GmbH, grants from Deutsche Krebshilfe, grants from Essex Pharma, grants from Guerbet, grants from INC Research, grants from lnSightec Ud, grants from IPSEN Pharma, grants from Kendlel MorphoSys AG, grants from Lilly GmbH, grants from MeVis Medical Solutions AG, grants from Nexus Oncology, grants from Novartis, grants from Parexel Clinical Research Organisation Service, grants from Pfizer GmbH, grants from Philipps, grants from Sanofis-Aventis, grants from Siemens, grants from Teruma Medical Corporation, grants from Toshiba, grants from Zukunftsfond Berlin, grants from Amgen, grants from AO Foundation, grants from BARD, grants from BBraun, grants from Boehring Ingelheimer, grants from Brainsgate, grants from CELLACT Pharma, grants from CeloNova Bio-Sciences, grants from GlaxoSmithKline, grants from Jansen, grants from Roehe, grants from Sehumaeher GmbH, grants from Medronic, grants from Pluristem, grants from Quintiles, grants from Roehe, grants from Astellas, grants from Chiltern, grants from Respicardia, grants from TEVA, grants from Abbvie, grants from AstraZenaca, grants from Galmed Research and Development Ltd, outside the submitted work. K.G.H. reports personal fees from AbbVie, personal fees from Pfizer, personal fees from MSD, personal fees from Roche, outside the submitted work. D.P. reports grants and personal fees from AbbVie, during the conduct of the study; grants and personal fees from AbbVie, personal fees from BMS, personal fees from Celgene, grants and personal fees from Lilly, grants and personal fees from MSD, grants and personal fees from Novartis, grants and personal fees from Pfizer, personal fees from Roche, personal fees from UCB, outside the submitted work.

Funding Statement

GESPIC was initially supported by the German Federal Ministry of Education and Research (Bundesministerium fuer Bildung und Forschung-BMBF). As consequence of the funding reduction by BMBF according to schedule in 2005 and stopped in 2007, complementary financial support has been obtained also from Abbott, Amgen, Centocor, Schering-Plough, and Wyeth. Starting from 2010, the core GESPIC cohort was supported by AbbVie. The PROOF study is funded by AbbVie. We would like to thank AbbVie for allowing the use of the PROOF dataset for the aim of the current study.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Charite

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

Data are available upon reasonable request.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted June 25, 2020.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Detecting radiographic sacroiliitis using deep learning with expert-level accuracy in axial spondyloarthritis
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Detecting radiographic sacroiliitis using deep learning with expert-level accuracy in axial spondyloarthritis
Keno K. Bressem, Janis L. Vahldiek, Lisa C. Adams, Stefan M. Niehues, Hildrun Haibel, Valeria Rios Rodriguez, Murat Torgutalp, Mikhail Protopopov, Fabian Proft, Judith Rademacher, Joachim Sieper, Martin Rudwaleit, Bernd Hamm, Marcus R. Makowski, Kay Geert A. Hermann, Denis Poddubnyy
medRxiv 2020.05.19.20105304; doi: https://doi.org/10.1101/2020.05.19.20105304
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Detecting radiographic sacroiliitis using deep learning with expert-level accuracy in axial spondyloarthritis
Keno K. Bressem, Janis L. Vahldiek, Lisa C. Adams, Stefan M. Niehues, Hildrun Haibel, Valeria Rios Rodriguez, Murat Torgutalp, Mikhail Protopopov, Fabian Proft, Judith Rademacher, Joachim Sieper, Martin Rudwaleit, Bernd Hamm, Marcus R. Makowski, Kay Geert A. Hermann, Denis Poddubnyy
medRxiv 2020.05.19.20105304; doi: https://doi.org/10.1101/2020.05.19.20105304

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Radiology and Imaging
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)