Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

AMELIE 3: Fully Automated Mendelian Patient Reanalysis at Under 1 Alert per Patient per Year

Johannes Birgmeier, Ethan Steinberg, Ethan E. Bodle, Cole A. Deisseroth, Karthik A. Jagadeesh, Jennefer N. Kohler, Devon Bonner, Shruti Marwaha, Julian A. Martinez-Agosto, Stan Nelson, Christina G. Palmer, Joy D. Cogan, Rizwan Hamid, Joan M. Stoler, Joel B. Krier, Jill A. Rosenfeld, Paolo Moretti, David R. Adams, Vandana Shashi, Elizabeth A. Worthey, Christine M. Eng, Euan A. Ashley, Matthew T. Wheeler, Undiagnosed Diseases Network, Peter D. Stenson, David N. Cooper, Jonathan A. Bernstein, Gill Bejerano
doi: https://doi.org/10.1101/2020.12.29.20248974
Johannes Birgmeier
1Department of Computer Science, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ethan Steinberg
1Department of Computer Science, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ethan E. Bodle
2Department of Pediatrics, Stanford School of Medicine, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cole A. Deisseroth
1Department of Computer Science, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karthik A. Jagadeesh
1Department of Computer Science, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jennefer N. Kohler
3Center for Undiagnosed Diseases, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Devon Bonner
3Center for Undiagnosed Diseases, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shruti Marwaha
3Center for Undiagnosed Diseases, Stanford University, Stanford, CA, USA
4Department of Medicine, School of Medicine, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Julian A. Martinez-Agosto
5Department of Human Genetics, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
6Department of Pediatrics, Division of Medical Genetics, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
8Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stan Nelson
5Department of Human Genetics, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
7Department of Pathology and Laboratory Medicine, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christina G. Palmer
5Department of Human Genetics, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
8Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joy D. Cogan
9Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rizwan Hamid
9Department of Pediatrics, Vanderbilt University Medical Center, Nashville, TN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joan M. Stoler
10Division of Genetics and Genomics, Department of Medicine, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joel B. Krier
11Dept of Medicine, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jill A. Rosenfeld
12Dept of Molecular and Human Genetics Baylor College of Medicine, Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paolo Moretti
13Department of Neurology University of Utah and George E. Wahlen VA Medical Center Salt Lake City, UT, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David R. Adams
14NIH Undiagnosed Diseases Program, Common Fund, Office of the Director, NIH, Bethesda, MD, USA
15Office of the Clinical Director, National Human Genome Research Institute, NIH, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Vandana Shashi
16Division of Medical Genetics, Department of Pediatrics, Duke Health, Durham, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth A. Worthey
17Software Development and Informatics, HudsonAlpha Institute for Biotechnology, Huntsville, AL, USA
18Departments of Pediatric and Pathology, University of Birmingham School of Medicine, Birmingham, AL, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christine M. Eng
12Dept of Molecular and Human Genetics Baylor College of Medicine, Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Euan A. Ashley
3Center for Undiagnosed Diseases, Stanford University, Stanford, CA, USA
4Department of Medicine, School of Medicine, Stanford University, Stanford, CA, USA
19Department of Genetics, School of Medicine, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew T. Wheeler
3Center for Undiagnosed Diseases, Stanford University, Stanford, CA, USA
4Department of Medicine, School of Medicine, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter D. Stenson
20Institute of Medical Genetics, School of Medicine, Cardiff University, Heath Park, Cardiff, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David N. Cooper
20Institute of Medical Genetics, School of Medicine, Cardiff University, Heath Park, Cardiff, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan A. Bernstein
2Department of Pediatrics, Stanford School of Medicine, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gill Bejerano
1Department of Computer Science, Stanford University, Stanford, CA, USA
2Department of Pediatrics, Stanford School of Medicine, Stanford, CA, USA
21Department of Developmental Biology, Stanford University, Stanford, CA, USA
22Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: bejerano{at}stanford.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Many thousands of patients with a suspected Mendelian disease have their exomes/genomes sequenced every year, but only about 30% receive a definitive diagnosis. Since a novel Mendelian gene-disease association is published on average every business day, thousands of undiagnosed patient cases could receive a diagnosis each year if their genomes were regularly compared to the latest literature. With millions of genomes expected to be sequenced for rare disease analysis by 2025, and considering the current publication rate of 1.1 million new articles per annum in PubMed, manually reanalyzing the growing cases of undiagnosed patients is not sustainable.

Methods We describe a fully automated reanalysis framework for patients with suspected, but undiagnosed, Mendelian disorders. The presented framework was tested by automatically parsing all ∼100,000 newly published peer reviewed papers every month and matching them on genotype and phenotype with all stored undiagnosed patients. If a new article contains a possible diagnosis for an undiagnosed patient, the system provides notification. We test the accuracy of the automatic reanalysis system on 110 patients, including 61 with available trio data.

Results Even when trained only on older data, our system identifies 80% of reanalysis diagnoses, while sending only 0.5-1 alerts per patient per year, a 100-1,000-fold efficiency gain over manual literature surveillance of equivalent yield.

Conclusion We show that automatic reanalysis of patients with suspected Mendelian disease is feasible and has the potential to greatly streamline diagnosis. Our system is not intended to replace clinical judgment. Rather, clinical diagnostic services could greatly benefit from a modest re-allocation of time from manual literature exploration to review of automated reanalysis alerts. Our system additionally supports a new paradigm for medical IT systems: proactive, continuously learning and consequently able to autonomously identify valuable insights as they emerge in digital health records. We have launched automated patient reanalysis, trained on the latest data, with user accounts and daily literature updates at https://AMELIE.stanford.edu.

Competing Interest Statement

DNC and PDS acknowledge the receipt of financial support from Qiagen Inc through a License Agreement with Cardiff University. The Department of Molecular and Human Genetics at Baylor College of Medicine receives revenue from clinical genetic testing completed at Baylor Genetics. EAA is advisor to Apple, co-founder of Personalis Inc., and of DeepCell Inc. MTW is a stockholder of Personalis. The remaining authors declare no conflict of interest.

Funding Statement

All computational work was funded only by a Bio-X SIGF fellowship (JB), the Stanford Department of Pediatrics (JAB, GB), a Packard Foundation Fellowship (GB), and a Microsoft Faculty Fellowship (GB). UDN curated data used in this manuscript was supported by the NIH.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

De-identified data from the DDD project were accessed via the European Genome-Phenome Archive (study EGAS00001000775). As applicable to the participating patients, the study protocol was reviewed and approved by the Stanford University Institutional Review Board (IRB-32036) and the central IRB at the NIH National Human Genome Research Institute for the Undiagnosed Diseases Network. Written informed consent was obtained from all participants.

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

A portion of the data we use is available from EGA. Another portion is of consented Stanford or UDN patients. Some of the latter can be shared while respecting consent conditions.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted January 04, 2021.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
AMELIE 3: Fully Automated Mendelian Patient Reanalysis at Under 1 Alert per Patient per Year
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
AMELIE 3: Fully Automated Mendelian Patient Reanalysis at Under 1 Alert per Patient per Year
Johannes Birgmeier, Ethan Steinberg, Ethan E. Bodle, Cole A. Deisseroth, Karthik A. Jagadeesh, Jennefer N. Kohler, Devon Bonner, Shruti Marwaha, Julian A. Martinez-Agosto, Stan Nelson, Christina G. Palmer, Joy D. Cogan, Rizwan Hamid, Joan M. Stoler, Joel B. Krier, Jill A. Rosenfeld, Paolo Moretti, David R. Adams, Vandana Shashi, Elizabeth A. Worthey, Christine M. Eng, Euan A. Ashley, Matthew T. Wheeler, Undiagnosed Diseases Network, Peter D. Stenson, David N. Cooper, Jonathan A. Bernstein, Gill Bejerano
medRxiv 2020.12.29.20248974; doi: https://doi.org/10.1101/2020.12.29.20248974
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
AMELIE 3: Fully Automated Mendelian Patient Reanalysis at Under 1 Alert per Patient per Year
Johannes Birgmeier, Ethan Steinberg, Ethan E. Bodle, Cole A. Deisseroth, Karthik A. Jagadeesh, Jennefer N. Kohler, Devon Bonner, Shruti Marwaha, Julian A. Martinez-Agosto, Stan Nelson, Christina G. Palmer, Joy D. Cogan, Rizwan Hamid, Joan M. Stoler, Joel B. Krier, Jill A. Rosenfeld, Paolo Moretti, David R. Adams, Vandana Shashi, Elizabeth A. Worthey, Christine M. Eng, Euan A. Ashley, Matthew T. Wheeler, Undiagnosed Diseases Network, Peter D. Stenson, David N. Cooper, Jonathan A. Bernstein, Gill Bejerano
medRxiv 2020.12.29.20248974; doi: https://doi.org/10.1101/2020.12.29.20248974

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Genetic and Genomic Medicine
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)