Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

A predictive atlas of disease onset from retinal fundus photographs

View ORCID ProfileThore Buergel, View ORCID ProfileLukas Loock, View ORCID ProfileJakob Steinfeldt, Laura Hoffmann, View ORCID ProfileSteffen Emil Künzel, View ORCID ProfileJulius Upmeier zu Belzen, View ORCID ProfileAnthony P. Khawaja, View ORCID ProfileRobert Luben, View ORCID ProfilePaul J. Foster, View ORCID ProfileClaudia Langenberg, View ORCID ProfileUlf Landmesser, View ORCID ProfileJohn Deanfield, View ORCID ProfileOliver Zeitz, Antonia Joussen, View ORCID ProfileMaik Pietzner, View ORCID ProfileBenjamin Wild, View ORCID ProfileRoland Eils
doi: https://doi.org/10.1101/2024.03.15.24304339
Thore Buergel
1Center for Digital Health, Berlin Institute of Health (BIH) at Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
2Institute of Cardiovascular Sciences, University College London, London, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Thore Buergel
Lukas Loock
1Center for Digital Health, Berlin Institute of Health (BIH) at Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lukas Loock
Jakob Steinfeldt
2Institute of Cardiovascular Sciences, University College London, London, UK,
3Computational Medicine, Berlin Institute of Health (BIH) at Charite - Universitätsmedizin Berlin, Berlin, Germany,
4Deutsches Herzzentrum der Charité (DHZC), Department of Cardiology, Angiology and Intensive Care Medicine, Berlin, Germany,
5Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany,
6Friede Springer Cardiovascular Prevention Center@Charite, Charite - University Medicine Berlin, Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jakob Steinfeldt
Laura Hoffmann
5Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany,
13Department of Ophthalmology, Charite - University Medicine Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Steffen Emil Künzel
5Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany,
10Berlin Institute of Health (BIH), Charite - University Medicine Berlin, Berlin, Germany,
13Department of Ophthalmology, Charite - University Medicine Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Steffen Emil Künzel
Julius Upmeier zu Belzen
1Center for Digital Health, Berlin Institute of Health (BIH) at Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Julius Upmeier zu Belzen
Anthony P. Khawaja
7NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London EC1V 9EL, UK,
8MRC Epidemiology Unit, University of Cambridge, Cambridge CB2 0SL, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Anthony P. Khawaja
Robert Luben
7NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London EC1V 9EL, UK,
8MRC Epidemiology Unit, University of Cambridge, Cambridge CB2 0SL, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Robert Luben
Paul J. Foster
7NIHR Biomedical Research Centre at Moorfields Eye Hospital and UCL Institute of Ophthalmology, London EC1V 9EL, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Paul J. Foster
Claudia Langenberg
3Computational Medicine, Berlin Institute of Health (BIH) at Charite - Universitätsmedizin Berlin, Berlin, Germany,
8MRC Epidemiology Unit, University of Cambridge, Cambridge CB2 0SL, UK,
9Precision Health University Research Institute, Queen Mary University of London, London, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Claudia Langenberg
Ulf Landmesser
4Deutsches Herzzentrum der Charité (DHZC), Department of Cardiology, Angiology and Intensive Care Medicine, Berlin, Germany,
5Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany,
6Friede Springer Cardiovascular Prevention Center@Charite, Charite - University Medicine Berlin, Berlin, Germany,
10Berlin Institute of Health (BIH), Charite - University Medicine Berlin, Berlin, Germany,
11DZHK (German Centre for Cardiovascular Research), Partner Site Berlin, Berlin, Berlin, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ulf Landmesser
John Deanfield
2Institute of Cardiovascular Sciences, University College London, London, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for John Deanfield
Oliver Zeitz
5Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany,
13Department of Ophthalmology, Charite - University Medicine Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Oliver Zeitz
Antonia Joussen
5Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany,
13Department of Ophthalmology, Charite - University Medicine Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maik Pietzner
3Computational Medicine, Berlin Institute of Health (BIH) at Charite - Universitätsmedizin Berlin, Berlin, Germany,
8MRC Epidemiology Unit, University of Cambridge, Cambridge CB2 0SL, UK,
9Precision Health University Research Institute, Queen Mary University of London, London, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maik Pietzner
Benjamin Wild
1Center for Digital Health, Berlin Institute of Health (BIH) at Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
2Institute of Cardiovascular Sciences, University College London, London, UK,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benjamin Wild
Roland Eils
1Center for Digital Health, Berlin Institute of Health (BIH) at Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin, Germany
12Health Data Science Unit, Heidelberg University Hospital and BioQuant, Heidelberg, Germany,
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Roland Eils
  • For correspondence: roland.eils{at}bih-charite.de
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Early detection of high-risk individuals is crucial for healthcare systems to cope with changing demographics and an ever-increasing patient population. Images of the retinal fundus are a non-invasive, low-cost examination routinely collected and potentially scalable beyond ophthalmology. Prior work demonstrated the potential of retinal images for risk assessment for common cardiometabolic diseases, but it remains unclear whether this potential extends to a broader range of human diseases. Here, we extended a retinal foundation model (RETFound) to systematically explore the predictive potential of retinal images as a low-cost screening strategy for disease onset across >750 incident diseases in >60,000 individuals. For more than a third (n=308) of the diseases, we demonstrated improved discriminative performance compared to readily available patient characteristics. This included 281 diseases outside of ophthalmology, such as type 2 diabetes (Delta C-Index: UK Biobank +0.073 (0.068, 0.079)) or chronic obstructive pulmonary disease (Delta C-Index: UK Biobank +0.047 (0.039, 0.054)), showcasing the potential of retinal images to complement screening strategies more widely. Moreover, we externally validated these findings in 7,248 individuals from the EPIC-Norfolk Eye Study. Notably, retinal information did not improve the prediction for the onset of cardiovascular diseases compared to established primary prevention scores, demonstrating the need for rigorous benchmarking and disease-agnostic efforts to design cost-efficient screening strategies to improve population health. We demonstrated that predictive improvements were attributable to retinal vascularisation patterns and less obvious features, such as eye colour or lens morphology, by extracting image attributions from risk models and performing genome-wide association studies, respectively. Genetic findings further highlighted commonalities between eye-derived risk estimates and complex disorders, including novel loci, such as IMAP1, for iron homeostasis. In conclusion, we present the first comprehensive evaluation of predictive information derived from retinal fundus photographs, illustrating the potential and limitations of easily accessible and low-cost retinal images for risk assessment across common and rare diseases.

Evidence before this study Before undertaking this study, we reviewed the literature on the predictive utility of medical imaging for disease onset, focusing particularly on retinal fundus photographs. We conducted searches in databases including PubMed and Google Scholar, spanning from the inception of these databases to January 1, 2023. Our search terms included “retinal fundus photography”, “disease prediction”, “machine learning”, “deep learning”, and “healthcare AI”, without language restrictions. Prior research has shown the promise of retinal images in diagnosing and predicting a range of conditions, notably within ophthalmology and specific systemic diseases such as diabetes and cardiovascular diseases. However, a comprehensive evaluation of retinal images’ predictive potential across a broad spectrum of diseases, particularly those without known associations to retinal changes, was lacking. Studies identified varied in quality, with many focusing on single diseases or small datasets, indicating a potential risk of bias and overfitting.

Added value of this study Our study extends the application of retinal fundus photographs from ophthalmological and systemic diseases to more than 750 incident diseases, leveraging a foundation model combined with a deep multi-task neural network. This represents the first systematic exploration of the predictive potential of retinal images across the human phenome, significantly expanding the scope of diseases for which these images could serve as a low-cost screening strategy. Moreover, we rigorously compare the predictive value of retinal images against established primary prevention scores for cardiovascular diseases, showing both the strengths and limitations of this approach. This dual focus provides a nuanced understanding of where retinal imaging can complement existing screening strategies and where it may not offer additional predictive value.

Implications of all the available evidence The evidence from our study, combined with existing research, suggests that retinal fundus photographs hold promise for predicting disease onset across a wide range of conditions, far beyond their current use. However, our work also emphasizes the importance of contextualizing these findings within the broader landscape of available prediction tools and established primary prevention. The implications for practice include the potential integration of retinal imaging into broader screening programs, particularly for diseases where predictive gains over existing methods are demonstrated. For policy, our findings advocate for further investment in AI and machine learning research in healthcare, particularly in methods that improve upon or complement existing prediction models. Future research should focus on refining these predictive models, exploring the integration of retinal imaging with other biomarkers, and conducting prospective studies to validate the clinical utility of these approaches in diverse populations.

Competing Interest Statement

U.L. received grants from Bayer, Novartis, Amgen, consulting fees from Bayer, Sanofi, Amgen, Novartis, Daichy Sankyo, and honoraria from Novartis, Sanofi, Bayer, Amgen, Daichy Sankyo. J.D. received consulting fees from GENinCode UK Ltd, honoraria from Amgen, Boehringer Ingelheim, Merck, Pfizer, Aegerion, Novartis, Sanofi, Takeda, Novo Nordisk, Bayer, and is chief medical advisor to Our Future Health. R.E. received honoraria from Sanofi and consulting fees from Boehringer Ingelheim. APK has acted as a paid consultant or lecturer to Abbvie, Aerie, Allergan, Google Health, Heidelberg Engineering, Novartis, Reichert, Santen, Thea and Topcon. PJF received personal fees from Allergan, Carl Zeiss, Google/DeepMind and Santen, outside the submitted work. All other authors do declare no competing interests. O.Z. received grants from Bayer, Boehringer-Ingelheim, Novartis, consulting fees from Allergan/AbbVie, Bayer, Boehringer-Ingelheim, Novartis, Omeicos, Oxular, Roche, SamChungDang Pharma, and honoraria from Allergan/AbbVie, Bayer, Boehringer-Ingelheim, Novartis, Roche.

Funding Statement

The EPIC-Norfolk study (DOI 10.22025/2019.10.105.00004) has received funding from the Medical Research Council (MR/N003284/1 and MC-UU_12015/1) and Cancer Research UK (C864/A14136). This project has been funded by the Charite - Universitaetsmedizin Berlin and the Einstein Foundation Berlin, through the Einstein BIH Visiting Fellowship awarded to J.D. The study has been supported by the BMBF-funded Medical Informatics Initiative (HiGHmed, 01ZZ1802A29 - 01ZZ1802Z) and the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) Project-ID 437531118 SFB 1470. APK is supported by a UK Research and Innovation Future Leaders Fellowship, an Alcon Research Institute Young Investigator Award and a Lister Institute for Preventive Medicine Award. This research was supported by the NIHR Biomedical Research Centre (BRC) at Moorfields Eye Hospital and the UCL Institute of Ophthalmology. PJF and APK received salary support from the NIHR BRC at Moorfields Eye Hospital. PJF received an unrestricted grant from the Alcon Research Institute, and support from the Richard Desmond Charitable Trust.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This research was conducted using data from UK Biobank, a major biomedical database (https://www.ukbiobank.ac.uk/) via application no. 51157 and 44448. Further, we used data from the EPIC-Norfolk (DOI 10.22025/2019.10.105.00004) study via the application of APK. Both studies have received ethical approval from their respective institutional review boards and have obtained informed consent from participants.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

UK Biobank data, including retinal fundus photographs, are available to bona fide researchers upon application at http://www.ukbiobank.ac.uk/using-the-resource/. Detailed information on predictors and endpoints used in this study is presented in Supplementary Tables 2-3. EPIC-Norfolk data are available for the scientific community, and researchers are invited to apply for data access at https://www.epic-norfolk.org.uk/for-researchers/data-sharing/data-requests/.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted March 16, 2024.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A predictive atlas of disease onset from retinal fundus photographs
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A predictive atlas of disease onset from retinal fundus photographs
Thore Buergel, Lukas Loock, Jakob Steinfeldt, Laura Hoffmann, Steffen Emil Künzel, Julius Upmeier zu Belzen, Anthony P. Khawaja, Robert Luben, Paul J. Foster, Claudia Langenberg, Ulf Landmesser, John Deanfield, Oliver Zeitz, Antonia Joussen, Maik Pietzner, Benjamin Wild, Roland Eils
medRxiv 2024.03.15.24304339; doi: https://doi.org/10.1101/2024.03.15.24304339
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
A predictive atlas of disease onset from retinal fundus photographs
Thore Buergel, Lukas Loock, Jakob Steinfeldt, Laura Hoffmann, Steffen Emil Künzel, Julius Upmeier zu Belzen, Anthony P. Khawaja, Robert Luben, Paul J. Foster, Claudia Langenberg, Ulf Landmesser, John Deanfield, Oliver Zeitz, Antonia Joussen, Maik Pietzner, Benjamin Wild, Roland Eils
medRxiv 2024.03.15.24304339; doi: https://doi.org/10.1101/2024.03.15.24304339

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Public and Global Health
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)