Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Improving reporting standards for polygenic scores in risk prediction studies

View ORCID ProfileHannah Wand, View ORCID ProfileSamuel A. Lambert, Cecelia Tamburro, Michael A. Iacocca, Jack W. O’Sullivan, Catherine Sillari, Iftikhar J. Kullo, Robb Rowley, Jacqueline S. Dron, Deanna Brockman, Eric Venner, Mark I. McCarthy, Antonis C. Antoniou, Douglas F. Easton, View ORCID ProfileRobert A. Hegele, View ORCID ProfileAmit V. Khera, Nilanjan Chatterjee, Charles Kooperberg, Karen Edwards, Katherine Vlessis, Kim Kinnear, John N. Danesh, Helen Parkinson, Erin M. Ramos, Megan C. Roberts, Kelly E. Ormond, Muin J. Khoury, A. Cecile J.W. Janssens, View ORCID ProfileKatrina A.B. Goddard, Peter Kraft, Jaqueline A. L. MacArthur, View ORCID ProfileMichael Inouye, View ORCID ProfileGenevieve Wojcik
doi: https://doi.org/10.1101/2020.04.23.20077099
Hannah Wand
1Stanford University School of Medicine, Stanford, CA, USA
2Stanford Center for Inherited Cardiovascular Disease, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hannah Wand
Samuel A. Lambert
3Cambridge Baker Systems Genomic Initiative, University of Cambridge, Cambridge, UK
4Cambridge Baker Systems Genomic Initiative, Baker Heart and Diabetes Institute, Melbourne, AUS
5BHF Cardiovascular Epidemiology Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
6Health Data Research UK-Cambridge, Wellcome Genome Campus, Hinxton, UK
7European Molecular Biology Laboratory, European Bioinformatics Institute, Wellcome Genome Campus, Hinxton, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Samuel A. Lambert
Cecelia Tamburro
8National Human Genome Research Institute, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael A. Iacocca
1Stanford University School of Medicine, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jack W. O’Sullivan
1Stanford University School of Medicine, Stanford, CA, USA
2Stanford Center for Inherited Cardiovascular Disease, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Catherine Sillari
8National Human Genome Research Institute, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Iftikhar J. Kullo
9Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robb Rowley
8National Human Genome Research Institute, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacqueline S. Dron
10Center for Genomic Medicine, Massachusetts General Hospital, Boston, MA, USA
11Western University, London, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Deanna Brockman
10Center for Genomic Medicine, Massachusetts General Hospital, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eric Venner
12Baylor College of Medicine, Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark I. McCarthy
13Department of Human Genetics, Genentech, South San Francisco, CA, USA
14Wellcome Centre for Human Genetics, Oxford, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Antonis C. Antoniou
15University of Cambridge, Cambridge, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Douglas F. Easton
15University of Cambridge, Cambridge, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert A. Hegele
11Western University, London, ON, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Robert A. Hegele
Amit V. Khera
10Center for Genomic Medicine, Massachusetts General Hospital, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Amit V. Khera
Nilanjan Chatterjee
16Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
17Department of Oncology, Johns Hopkins School of Medicine, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Charles Kooperberg
18Division of Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle, WA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Karen Edwards
19Department of Epidemiology, University of California, Irvine, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Katherine Vlessis
20Department of Genetics, Stanford University School of Medicine, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kim Kinnear
20Department of Genetics, Stanford University School of Medicine, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John N. Danesh
5BHF Cardiovascular Epidemiology Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
6Health Data Research UK-Cambridge, Wellcome Genome Campus, Hinxton, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Helen Parkinson
6Health Data Research UK-Cambridge, Wellcome Genome Campus, Hinxton, UK
7European Molecular Biology Laboratory, European Bioinformatics Institute, Wellcome Genome Campus, Hinxton, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Erin M. Ramos
8National Human Genome Research Institute, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Megan C. Roberts
22Division of Pharmaceutical Outcomes and Policy, UNC Eshelman School of Pharmacy, Chapel Hill, NC, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kelly E. Ormond
20Department of Genetics, Stanford University School of Medicine, Stanford, CA, USA
23Stanford Center for Biomedical Ethics, Stanford University School of Medicine, Stanford, CA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Muin J. Khoury
24Centers for Disease Control and Prevention, Atlanta, GA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A. Cecile J.W. Janssens
25Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Katrina A.B. Goddard
26Department of Translational and Applied Genomics, Kaiser Permanente Northwest, Portland, OR, USA
27Center for Health Research, Kaiser Permanente Northwest, Portland, OR, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Katrina A.B. Goddard
Peter Kraft
28Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jaqueline A. L. MacArthur
7European Molecular Biology Laboratory, European Bioinformatics Institute, Wellcome Genome Campus, Hinxton, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael Inouye
3Cambridge Baker Systems Genomic Initiative, University of Cambridge, Cambridge, UK
4Cambridge Baker Systems Genomic Initiative, Baker Heart and Diabetes Institute, Melbourne, AUS
5BHF Cardiovascular Epidemiology Unit, Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
6Health Data Research UK-Cambridge, Wellcome Genome Campus, Hinxton, UK
21National Institute for Health Research Cambridge Biomedical Research Centre, University of Cambridge and Cambridge University Hospitals, Cambridge, UK
29The Alan Turing Institute, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michael Inouye
Genevieve Wojcik
30Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Genevieve Wojcik
  • For correspondence: gwojcik1{at}jhu.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Polygenic risk scores (PRS), often aggregating the results from genome-wide association studies, can bridge the gap between the initial discovery efforts and clinical applications for disease risk estimation. However, there is remarkable heterogeneity in the reporting of these risk scores. This lack of adherence to reporting standards hinders the translation of PRS into clinical care. The ClinGen Complex Disease Working Group, in a collaboration with the Polygenic Score (PGS) Catalog, have updated the Genetic Risk Prediction (GRIPS) Reporting Statement to the current state of the field and to enable downstream utility. Drawing upon experts in epidemiology, statistics, disease-specific applications, implementation, and policy, this 22-item reporting framework defines the minimal information needed to interpret and evaluate a PRS, especially with respect to any downstream clinical applications. Items span detailed descriptions of the study population (recruitment method, key demographic and clinical characteristics, inclusion/exclusion criteria, and outcome definition), statistical methods for both PRS development and validation, and considerations for potential limitations of the published risk score and downstream clinical utility. Additionally, emphasis has been placed on data availability and transparency to facilitate reproducibility and benchmarking against other PRS, such as deposition in the publicly available PGS Catalog. By providing these criteria in a structured format that builds upon existing standards and ontologies, the use of this framework in publishing PRS will facilitate translation of PRS into clinical care and progress towards defining best practices.

Summary In recent years, polygenic risk scores (PRS) have increasingly been used to capture the genome-wide liability underlying many human traits and diseases, hoping to better inform an individual’s genetic risk. However, a lack of adherence to existing reporting standards has hindered the translation of this important tool into clinical and public health practice; in particular, details necessary for benchmarking and reproducibility are underreported. To address this gap, the ClinGen Complex Disease Working Group and Polygenic Score (PGS) Catalog have updated the Genetic Risk Prediction (GRIPS) Reporting Statement into the 22-item Polygenic Risk Score Reporting Statement (PRS-RS). This framework provides the minimal information expected of authors to promote the validity, transparency, and reproducibility of PRS by encouraging authors to detail the study population, statistical methods, and potential clinical utility of a published score. The widespread adoption of this framework will encourage rigorous methodological consideration and facilitate benchmarking to ensure high quality scores are translated into the clinic.

Competing Interest Statement

MIM is on the advisory panels Pfizer, Novo Nordisk, and Zoe Global; Honoraria: Merck, Pfizer, Novo Nordisk, and Eli Lilly; Research funding: Abbvie, Astra Zeneca, Boehringer Ingelheim, Eli Lilly, Janssen, Merck, Novo Nordisk, Pfizer, Roche, Sanofi Aventis, Servier & Takeda. As of June 2019, he is an employee of Genentech with stock and stock options in Roche. No other authors have competing interests to declare.

Funding Statement

ClinGen is primarily funded by the National Human Genome Research Institute (NHGRI), through the following three grants: U41HG006834, U41HG009649, U41HG009650. ClinGen also receives support for content curation from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), through the following three grants: U24HD093483, U24HD093486, U24HD093487. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Additionally, the views expressed in this article are those of the author(s) and not necessarily those of the NHS, the NIHR, or the Department of Health. Research reported in this publication was supported by the National Human Genome Research Institute of the National Institutes of Health under Award Number U41HG007823 (EBI-NHGRI GWAS Catalog, PGS Catalog). In addition, we acknowledge funding from the European Molecular Biology Laboratory. Individuals were funded from the following sources: MIM was a Wellcome Investigator and an NIHR Senior Investigator with funding from NIDDK (U01-DK105535); Wellcome (090532, 098381, 106130, 203141, 212259). MI, SAL, and JD were supported by core funding from: the UK Medical Research Council (MR/L003120/1), the British Heart Foundation (RG/13/13/30194; RG/18/13/33946) and the National Institute for Health Research (Cambridge Biomedical Research Centre at the Cambridge University Hospitals NHS Foundation Trust). SAL is supported by a Canadian Institutes of Health Research postdoctoral fellowship (MFE-171279). JD holds a British Heart Foundation Personal Chair and a National Institute for Health Research Senior Investigator Award. This work was also supported by Health Data Research UK, which is funded by the UK Medical Research Council, Engineering and Physical Sciences Research Council, Economic and Social Research Council, Department of Health and Social Care (England), Chief Scientist Office of the Scottish Government Health and Social Care Directorates, Health and Social Care Research and Development Division (Welsh Government), Public Health Agency (Northern Ireland), British Heart Foundation and Wellcome.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

N/A

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • ↵# Shared first authorship

  • ↵$ Shared senior authorship

  • PRS-RS has been revised and streamlined; author affiliations updated; Supplemental Materials added and updated; Figures updated.

Data Availability

N/A

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted November 24, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Improving reporting standards for polygenic scores in risk prediction studies
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Improving reporting standards for polygenic scores in risk prediction studies
Hannah Wand, Samuel A. Lambert, Cecelia Tamburro, Michael A. Iacocca, Jack W. O’Sullivan, Catherine Sillari, Iftikhar J. Kullo, Robb Rowley, Jacqueline S. Dron, Deanna Brockman, Eric Venner, Mark I. McCarthy, Antonis C. Antoniou, Douglas F. Easton, Robert A. Hegele, Amit V. Khera, Nilanjan Chatterjee, Charles Kooperberg, Karen Edwards, Katherine Vlessis, Kim Kinnear, John N. Danesh, Helen Parkinson, Erin M. Ramos, Megan C. Roberts, Kelly E. Ormond, Muin J. Khoury, A. Cecile J.W. Janssens, Katrina A.B. Goddard, Peter Kraft, Jaqueline A. L. MacArthur, Michael Inouye, Genevieve Wojcik
medRxiv 2020.04.23.20077099; doi: https://doi.org/10.1101/2020.04.23.20077099
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Improving reporting standards for polygenic scores in risk prediction studies
Hannah Wand, Samuel A. Lambert, Cecelia Tamburro, Michael A. Iacocca, Jack W. O’Sullivan, Catherine Sillari, Iftikhar J. Kullo, Robb Rowley, Jacqueline S. Dron, Deanna Brockman, Eric Venner, Mark I. McCarthy, Antonis C. Antoniou, Douglas F. Easton, Robert A. Hegele, Amit V. Khera, Nilanjan Chatterjee, Charles Kooperberg, Karen Edwards, Katherine Vlessis, Kim Kinnear, John N. Danesh, Helen Parkinson, Erin M. Ramos, Megan C. Roberts, Kelly E. Ormond, Muin J. Khoury, A. Cecile J.W. Janssens, Katrina A.B. Goddard, Peter Kraft, Jaqueline A. L. MacArthur, Michael Inouye, Genevieve Wojcik
medRxiv 2020.04.23.20077099; doi: https://doi.org/10.1101/2020.04.23.20077099

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Genetic and Genomic Medicine
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)