Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

HECTOR: multimodal deep learning predicts recurrence risk in endometrial cancer

View ORCID ProfileSarah Fremond-Volinsky, View ORCID ProfileNanda Horeweg, View ORCID ProfileSonali Andani, View ORCID ProfileJurriaan Barkey Wolf, Maxime W Lafarge, Cor de Kroon, View ORCID ProfileGitte Ørtoft, Estrid Høgdall, View ORCID ProfileJouke Dijkstra, View ORCID ProfileJan J Jobsen, View ORCID ProfileLudy CHW Lutgens, View ORCID ProfileMelanie E Powell, View ORCID ProfileLinda R Mileshkin, Helen Mackay, View ORCID ProfileAlexandra Leary, View ORCID ProfileDionyssios Katsaros, View ORCID ProfileHans W Nijman, View ORCID ProfileStephanie M de Boer, View ORCID ProfileRemi A Nout, View ORCID ProfileMarco de Bruyn, View ORCID ProfileDavid Church, View ORCID ProfileVincent THBM Smit, View ORCID ProfileCarien L Creutzberg, View ORCID ProfileViktor H Koelzer, View ORCID ProfileTjalling Bosse
doi: https://doi.org/10.1101/2023.11.27.23298994
Sarah Fremond-Volinsky
1Department of Pathology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sarah Fremond-Volinsky
Nanda Horeweg
2Department of Radiation Oncology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nanda Horeweg
Sonali Andani
3Department of Computer Science, ETH Zurich, Zurich, Switzerland; Department of Pathology and Molecular Pathology, University Hospital, University of Zurich, Zurich, Switzerland; Swiss Institute of Bioinformatics, Lausanne, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sonali Andani
Jurriaan Barkey Wolf
4Department of Pathology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jurriaan Barkey Wolf
Maxime W Lafarge
5Department of Pathology and Molecular Pathology, University Hospital Zurich, University of Zurich, Zurich, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cor de Kroon
6Department of Gynecology and Obstetrics, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gitte Ørtoft
7Department of Gynecology, Copenhagen University Hospital, Rigshospitalet, Copenhagen, Denmark
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Gitte Ørtoft
Estrid Høgdall
8Department of Pathology, Herlev University Hospital, Herlev, Denmark
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jouke Dijkstra
9Department of Radiology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jouke Dijkstra
Jan J Jobsen
10Department of Radiation Oncology, Medisch Spectrum Twente, Enschede, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jan J Jobsen
Ludy CHW Lutgens
11Department of Radiation Oncology, Maastricht UMC+, Maastricht, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ludy CHW Lutgens
Melanie E Powell
12Department of Clinical Oncology, Barts Health NHS Trust, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Melanie E Powell
Linda R Mileshkin
13Department of Medical Oncology, Peter MacCallum Cancer Center, Melbourne, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Linda R Mileshkin
Helen Mackay
14Department of Medical Oncology and Hematology, Odette Cancer Center Sunnybrook Health Sciences Center, Toronto, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexandra Leary
15Department Medical Oncology, Gustave Roussy Institute, Villejuif, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alexandra Leary
Dionyssios Katsaros
16Department of Surgical Sciences, Gynecologic Oncology, Città della Salute and S Anna Hospital, University of Turin, Turin, Italy
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Dionyssios Katsaros
Hans W Nijman
17Department of Obstetrics & Gynecology, University Medical Center Groningen, Groningen, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hans W Nijman
Stephanie M de Boer
18Department of Radiation Oncology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Stephanie M de Boer
Remi A Nout
19Department of Radiation Oncology, Erasmus University Medical Center, Rotterdam, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Remi A Nout
Marco de Bruyn
20Department of Gynaecologic Oncology, University Medical Center Groningen, Groningen, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Marco de Bruyn
David Church
21Wellcome Centre for Human Genetics, University of Oxford, Oxford, United Kingdom; Oxford NIHR Comprehensive Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for David Church
Vincent THBM Smit
22Department of Pathology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Vincent THBM Smit
Carien L Creutzberg
23Department of Radiation Oncology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Carien L Creutzberg
Viktor H Koelzer
24Department of Pathology and Molecular Pathology, University Hospital Zurich, University of Zurich, Zurich, Switzerland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Viktor H Koelzer
Tjalling Bosse
25Department of Pathology, Leiden University Medical Center, Leiden, Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Tjalling Bosse
  • For correspondence: t.bosse{at}lumc.nl
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Preview PDF
Loading

Abstract

Predicting distant recurrence of endometrial cancer (EC) is crucial for personalized adjuvant treatment. The current gold standard of combined pathological and molecular profiling is costly, hampering implementation. We developed HECTOR (Histopathology-based Endometrial Cancer Tailored Outcome Risk), a multimodal deep learning prognostic model using hematoxylin-and-eosin-stained whole-slide-images and tumor stage as input, on 1,912 patients from seven EC cohorts including the PORTEC-1/-2/-3 randomized trials. HECTOR demonstrated C-indices in internal (n = 353) and external (n = 151) test sets of 0.788 and 0.816 respectively, outperforming the current gold-standard, and identified patients with markedly different outcomes (10-year distant recurrence-free probabilities of 97.0%, 77.7% and 58.1% for HECTOR low, intermediate and high risk groups). HECTOR also predicted adjuvant chemotherapy benefit better than current methods. Morphological and genomic feature extraction identified correlates of HECTOR risk groups, some with therapeutic potential. HECTOR improves on the current gold-standard and may help delivery of personalized treatment in EC.

Competing Interest Statement

S.FV., N.H., V.H.K, and T.B. are co-inventors on the patent application number 23315438.4. N.H. declares to have received research grants from the Dutch Cancer Society (DCS) and Varian (paid to institution) unrelated to the current study. C.deK. declares KWF and ZonMW grants unrelated to the project. A.L. received funded research unrelated to the current study from AZ, Clovis, GSK, MSD, Ability, Zentalis, Agenus, Lovance, Sanofi, Roche, OSEimmuno, BMS; is an advisory board member or consultant for AZ, Clovis, GSK, MSD, Merck Serono, Ability, Zentalis, Agenus, and Blueprint; received honoraria and compensation for expenses from AZ, Clovis, and GSK. R.A.N. declared research grants unrelated to the current study to institution from Elekta, Varian, Accuray, Sensius; is an advisory board of MSD. M.B. received grants from the Dutch Cancer Society (KWF), the European Research Council (ERC), Health Holland (HH), Mendus, BioNovion, Aduro Biotech, Vicinivax, Genmab and IMMIOS (all paid to the institute) unrelated to the current study; received non-financial support from BioNTech, Surflay Nanotec and Merck Sharp & Dohme; is a stock option holder in Sairopa. D.C. is part of an advisory board of MSD; received research funding unrelated to the project of HalioDx and Veracyte (to TransSCOT consortium); spouse of an Amgen employee; affiliated to the Wellcome Centre for Human Genetics and NIHR Oxford BRC; received funding from Oxford NIHR Comprehensive Biomedical Research Centre (BRC) and Cancer Research UK (CRUK) Advanced Clinician Scientist Fellowship (C26642/A27963). C.L.C. received grants from the Dutch cancer Society for the PORTEC-1,2,3,4a, RAINBO trials and research grant for translational work on PORTEC; has leadership roles chair of GCIG Endometrial Cancer Committee. V.H.K. declared being an invited speaker for Sharing Progress in Cancer Care (SPCC) and Indica Labs; advisory board of Takeda; sponsored research agreements with Roche and IAG all unrelated to the current study. T.B. received grants unrelated to this work by the DCS. The remaining authors declare no competing interests. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, the Department of Health.

Funding Statement

This work was supported by a translational research project grant from the Hanarth Foundation and the Swiss Federal Institutes of Technology (strategic focus area of personalized health and related technologies; 2021-367) and a grant from the Promedica Foundation (F-87701-41-01) during the conduct of the study.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The PORTEC-1/-2/-3 study protocols were approved by the Medical Ethical Committee Leiden – Den Haag – Delft and the medical ethics committees at participating centers. Both studies were conducted in accordance with the principles of the Declaration of Helsinki. All patients provided signed informed consent to study participation. For the retrospective use of the clinical trials and retrospective cohorts (TransPORTEC study, MST), we have obtained ethical permission to use the data by the Medical Ethical Committee Leiden – Den Haag – Delft (B21.065 and B21.011) as well as the Leiden Cohort (nWMO‐D4‐2023‐002), and the Danish Cohort by the Center for Regional Udvikling – De Videnskabsetiske Komiteer(H-16025909).

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted November 27, 2023.
Download PDF

Supplementary Material

Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
HECTOR: multimodal deep learning predicts recurrence risk in endometrial cancer
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
HECTOR: multimodal deep learning predicts recurrence risk in endometrial cancer
Sarah Fremond-Volinsky, Nanda Horeweg, Sonali Andani, Jurriaan Barkey Wolf, Maxime W Lafarge, Cor de Kroon, Gitte Ørtoft, Estrid Høgdall, Jouke Dijkstra, Jan J Jobsen, Ludy CHW Lutgens, Melanie E Powell, Linda R Mileshkin, Helen Mackay, Alexandra Leary, Dionyssios Katsaros, Hans W Nijman, Stephanie M de Boer, Remi A Nout, Marco de Bruyn, David Church, Vincent THBM Smit, Carien L Creutzberg, Viktor H Koelzer, Tjalling Bosse
medRxiv 2023.11.27.23298994; doi: https://doi.org/10.1101/2023.11.27.23298994
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
HECTOR: multimodal deep learning predicts recurrence risk in endometrial cancer
Sarah Fremond-Volinsky, Nanda Horeweg, Sonali Andani, Jurriaan Barkey Wolf, Maxime W Lafarge, Cor de Kroon, Gitte Ørtoft, Estrid Høgdall, Jouke Dijkstra, Jan J Jobsen, Ludy CHW Lutgens, Melanie E Powell, Linda R Mileshkin, Helen Mackay, Alexandra Leary, Dionyssios Katsaros, Hans W Nijman, Stephanie M de Boer, Remi A Nout, Marco de Bruyn, David Church, Vincent THBM Smit, Carien L Creutzberg, Viktor H Koelzer, Tjalling Bosse
medRxiv 2023.11.27.23298994; doi: https://doi.org/10.1101/2023.11.27.23298994

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Oncology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)