Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

An independent external validation of the QRISK3 cardiovascular risk prediction model applied to UK Biobank participants

View ORCID ProfileRuth E. Parsons, Xiaonan Liu, Jennifer A. Collister, David A. Clifton, Benjamin J. Cairns, View ORCID ProfileLei Clifton
doi: https://doi.org/10.1101/2022.06.30.22277083
Ruth E. Parsons
1Nuffield Department of Population Health, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ruth E. Parsons
  • For correspondence: r.parsons21{at}imperial.ac.uk
Xiaonan Liu
1Nuffield Department of Population Health, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jennifer A. Collister
1Nuffield Department of Population Health, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David A. Clifton
2Department of Engineering Science, University of Oxford, United Kingdom
3Oxford-Suzhou Centre for Advanced Research, Suzhou, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin J. Cairns
4Our Future Health
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lei Clifton
1Nuffield Department of Population Health, University of Oxford
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lei Clifton
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background The QRISK3 cardiovascular disease (CVD) risk prediction model was derived using primary care data; however, it is frequently used outside of clinical settings. The use of QRISK3 in epidemiological studies without external validation may lead to inaccurate results, however it has been used multiple times on data from UK Biobank. We aimed to externally evaluate the performance of QRISK3 for predicting 10-year risk of cardiovascular events in the UK Biobank cohort.

Methods We used data from the UK Biobank, a large-scale prospective cohort study of 403,370 participants aged 40-69 years recruited between 2006 and 2010 in the United Kingdom (UK). We included participants with no previous history of CVD or statin treatment and the outcome was the first occurrence of coronary heart disease, ischaemic stroke or transient ischaemic attack, derived from linked hospital episode statistics (HES) and death registration data (DRD).

Results Our study population included 233,233 females and 170,137 males, with 9295 and 13,028 incident cardiovascular events, respectively. The overall median follow-up time after recruitment was 11.7 years. The discrimination measure of QRISK3 in the overall population was reasonable (Harrell’s C-Index 0.722 in females and 0.697 in males), this was poorer in older participants (<0.62 in all participants aged 65 or older). QRISK3 had systematic over-prediction of CVD risk in UK Biobank, particularly in older participants, by as much as 20%.

Conclusions QRISK3 had reasonable overall discrimination for the whole study population, which was best in younger participants. The observed CVD risk in UK Biobank participants was lower than that predicted by QRISK3, particularly for older participants. The UK Biobank cohort is known to be healthier than the general population and therefore it is necessary to recalibrate QRISK3 before using it to predict absolute CVD risk in the UK Biobank cohort.

Competing Interest Statement

D.A.C. declares academic grants from GlaxoSmithKline and personal fees from Oxford University Innovation, Biobeats and Sensyne Health, outside the context of this work. D.A.C is additionally supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

Funding Statement

The UK Biobank study was supported by the Wellcome Trust, Medical Research Council, Department of Health, Scottish government, and Northwest Regional Development Agency. It has also received funding from the Welsh Assembly government and British Heart Foundation.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The UK Biobank study received ethical approval from the North West Multi-center Research Ethics Committee (REC reference: 11/NW/03820). All participants gave written informed consent before enrolment in the study, which was conducted in accordance with the principles of the Declaration of Helsinki. This study has been conducted under the UK Biobank application number 33952.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Ethical approval: The UK Biobank study received ethical approval from the North West Multi-center Research Ethics Committee (REC reference: 11/NW/03820). All participants gave written informed consent before enrolment in the study, which was conducted in accordance with the principles of the Declaration of Helsinki. This study has been conducted under the UK Biobank application number 33952.

  • Funders: The UK Biobank study was supported by the Wellcome Trust, Medical Research Council, Department of Health, Scottish government, and Northwest Regional Development Agency. It has also received funding from the Welsh Assembly government and British Heart Foundation.

  • D.A.C. declares academic grants from GlaxoSmithKline and personal fees from Oxford University Innovation, Biobeats and Sensyne Health, outside the context of this work. D.A.C is additionally supported by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

  • We did not to involve participants in the design, or conduct, or reporting, or dissemination plans of our research.

  • Availability of data and material: This research has been conducted using the UK Biobank Resource under Application Number 33952. Requests to access the data should be made via application directly to the UK Biobank, https://www.ukbiobank.ac.uk

Data Availability

UK Biobank data are available through a procedure described at http://www.ukbiobank.ac.uk/using-the-resource/.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted June 30, 2022.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
An independent external validation of the QRISK3 cardiovascular risk prediction model applied to UK Biobank participants
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
An independent external validation of the QRISK3 cardiovascular risk prediction model applied to UK Biobank participants
Ruth E. Parsons, Xiaonan Liu, Jennifer A. Collister, David A. Clifton, Benjamin J. Cairns, Lei Clifton
medRxiv 2022.06.30.22277083; doi: https://doi.org/10.1101/2022.06.30.22277083
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
An independent external validation of the QRISK3 cardiovascular risk prediction model applied to UK Biobank participants
Ruth E. Parsons, Xiaonan Liu, Jennifer A. Collister, David A. Clifton, Benjamin J. Cairns, Lei Clifton
medRxiv 2022.06.30.22277083; doi: https://doi.org/10.1101/2022.06.30.22277083

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Cardiovascular Medicine
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)