Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Development and validation of an algorithm to estimate the risk of severe complications of COVID-19 to prioritise vaccination

View ORCID ProfileRon MC Herings, Karin MA Swart, Bernard AM Van der Zeijst, Amber A van der Heijden, Koos van der Velden, Eric G Hiddink, Martijn W Heymans, Reinier AR Herings, Hein PJ van Hout, Joline WJ Beulens, Giel Nijpels, Petra JM Elders
doi: https://doi.org/10.1101/2021.02.05.21251197
Ron MC Herings
1Department of Epidemiology & Data Science, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands
2Stichting Informatievoorziening voor Zorg en Onderzoek (STIZON), Utrecht, the Netherlands
Roles: professor of pharmacoepidemiology and care optimalisation
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ron MC Herings
  • For correspondence: ron.herings{at}pd-groep.nl
Karin MA Swart
3PHARMO Institute for Drug Outcome Research, Utrecht, the Netherlands
Roles: senior researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bernard AM Van der Zeijst
4Department of Medical Microbiology, Leiden University Medical Center, Leiden, the Netherlands
Roles: professor emeritus ‘vaccines and vaccination’
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amber A van der Heijden
5Department of General Practice, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam, the Netherlands
Roles: senior researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Koos van der Velden
6Department of Primary and Community Care, Academic Collaborative Center AMPHI, Integrated Health Policy, Radboud University Medical Center, Nijmegen, the Netherlands
Roles: professor of public health
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eric G Hiddink
7Stichting Health Base, Houten, the Netherlands
Roles: innovation manager
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martijn W Heymans
1Department of Epidemiology & Data Science, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands
Roles: assistant professor
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Reinier AR Herings
8Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands
Roles: medical student
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hein PJ van Hout
5Department of General Practice, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam, the Netherlands
Roles: professor of elderly care
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joline WJ Beulens
1Department of Epidemiology & Data Science, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands
Roles: professor of epidemiology of lifestyle and cardiometabolic disease
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Giel Nijpels
5Department of General Practice, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam, the Netherlands
Roles: professor of general practice
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Petra JM Elders
5Department of General Practice, Amsterdam UMC – Vrije Universiteit, Amsterdam Public Health, Amsterdam, the Netherlands
Roles: professor of general practice
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Objective To develop an algorithm (sCOVID) to predict the risk of severe complications of COVID- 19 in a community-dwelling population to optimise vaccination scenarios.

Design Population based cohort study

Setting 264 Dutch general practices contributing to the NL-COVID database

Participants 6074 people aged 0-99 diagnosed with COVID-19

Main outcome measures Severe complications (hospitalisation, institutionalisation, death). The algorithm was developed from a training dataset comprising 70% of the patients and validated in the remaining 30%. Potential predictor variables included age, sex, a chronic co-morbidity score (CCS) based on risk factors for COVID-19 complications as defined by the National Institute of Public Health and the Environment (RIVM), obesity, neighborhood deprivation score (NDS), first or second COVID wave, and confirmation test. Six different population vaccination scenarios were explored: 1) random (naive), 2) random for persons above 60 years (60plus), 3) oldest patients first in age bands of five years (oldest first), 4) target population of the annual influenza vaccination program (influenza) and 5) those 25-65 years of age first (worker), and 6) risk-based using the prediction algorithm (sCOVID). For each vaccination strategy the amount of vaccinations needed to reach a 50% reduction of severe complications was calculated.

Results Severe complications were reported in 243 (4.8%) people with 59 (20.3%) nursing home admissions, 181 (62.2%) hospitalisations and 51 (17.5%) deaths. The algorithm included age, sex, CCS, NDS, wave, and confirmation test with a c statistic of 0.91 (95% CI 0.88-0.94) in the validation set. Applied to different vaccination scenarios, the proportion of people needed to be vaccinated to reach a 50% reduction of severe complications was 67.5%, 50.0%, 26.1%, 16.0%, 10.0%, and 8.4% for the worker, naive, infuenza, 60plus, oldest first, and sCOVID scenarios respectively.

Conclusion COVID-19 related severe complications will be reduced most efficiently when vaccinations are risk-based, prioritizing the highest risk group using the sCOVID algorithm. The vaccination scenario, prioritising oldest people in age bands of 5 years down to 60 years of age, performed second best. The sCOVID algorithm can readily be applied to identify persons with highest risks from data in the electronic health records of GPs.

What is already known on this topic?

  • Severe COVID-19 complications may be reduced when persons at the highest risk will be vaccinated first.

  • To identify persons at a high risk for hospitalization or death in the general population, a limited number of prediction algorithms have been developed.

  • Most of these algorithms were based on data from the first wave of infections (spring 2020) when widespread testing was not always possible, limiting the usefulness of these algorithms.

What this study adds

  • Including data up to January 2021, we developed and validated a prediction algorithm (sCOVID) with a c-statistic of 0.91 (95% CI 0.88-0.94) based on age, sex, chronic comorbidity score, economic status, wave, and a confirmation test to identify patients in the general population that are at risk of severe COVID-19 complication.

  • Using the algorithm, a 50% reduction of patients with severe complications could be obtained with a vaccination coverage of only 8%. This vaccination scenario based on this algorithm was superior to other calculated vaccination scenarios.

  • The sCOVID algorithm can readily be implemented in the electronic health records of general practitioners.

Competing Interest Statement

All authors have completed the ICMJE uniform disclosure form and declare: RMCH is director of STIZON, an organization that is the processor of the NL-COVID data on behalf of the participating General Practitioners. EGH is an employee of Health base, an independent multidisciplinary foundation active in developing content for medical and pharmaceutical decision support systems, that was also applied for the NL-COVID database. KMAS is employee of the PHARMO Institute for Drug Outcomes Research. This independent research institute performs financially supported pharmaco-epidemiological studies for the government, healthcare authorities and pharmaceutical companies. BAMvdZ, AAvdH, KvdV, RARH, MWH, HvH, JWJB, GN, and PMJE declare no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, and no other relationships or activities that could appear to have influenced the submitted work.

Funding Statement

This study was funded by the Stichting Informatievoorziening voor Zorg en Onderzoek (STIZON), the PHARMO Institute, Medworq, ExpertDoc, Stichting Health base, PharmaPartners and CGM that made data available to the Amsterdam UMC. STIZON is a foundation acting as trusted third party to facilitate the use, data curation, standardisation and linkage of administrative databases and EHR records from general practitioners, pharmacist, clinical laboratories, hospitals and national registries for health service and epidemiological research dedicated to improving personalised health care in the real-world setting. PharmaPartners is market leader of medical administrative software for general practitioners and pharmacist. ExpertDoc is a clinical decision platform dedicated to assist general practitioners to deploy the standard and clinical rules as defined by the National Organization of General practitioners (NHG). Health Base is an independent multidisciplinary foundation active in developing content for medical and pharmaceutical decision support systems. Medworq is a company specialized in project management, stakeholder management and information products.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

the privacy and compliance committee of Stichting Informatie voorziening voor Zorg en Onderzoek (STIZON)

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

The data will be available on reasonable request.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted February 08, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Development and validation of an algorithm to estimate the risk of severe complications of COVID-19 to prioritise vaccination
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Development and validation of an algorithm to estimate the risk of severe complications of COVID-19 to prioritise vaccination
Ron MC Herings, Karin MA Swart, Bernard AM Van der Zeijst, Amber A van der Heijden, Koos van der Velden, Eric G Hiddink, Martijn W Heymans, Reinier AR Herings, Hein PJ van Hout, Joline WJ Beulens, Giel Nijpels, Petra JM Elders
medRxiv 2021.02.05.21251197; doi: https://doi.org/10.1101/2021.02.05.21251197
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Development and validation of an algorithm to estimate the risk of severe complications of COVID-19 to prioritise vaccination
Ron MC Herings, Karin MA Swart, Bernard AM Van der Zeijst, Amber A van der Heijden, Koos van der Velden, Eric G Hiddink, Martijn W Heymans, Reinier AR Herings, Hein PJ van Hout, Joline WJ Beulens, Giel Nijpels, Petra JM Elders
medRxiv 2021.02.05.21251197; doi: https://doi.org/10.1101/2021.02.05.21251197

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Primary Care Research
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)