Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Information bias of vaccine effectiveness estimation due to informed consent for national registration of COVID-19 vaccination

View ORCID ProfileC.H. (Henri) van Werkhoven, View ORCID ProfileBrechje de Gier, View ORCID ProfileScott McDonald, View ORCID ProfileHester E. de Melker, View ORCID ProfileSusan J.M. Hahné, View ORCID ProfileSusan van den Hof, View ORCID ProfileMirjam J. Knol
doi: https://doi.org/10.1101/2023.05.23.23290384
C.H. (Henri) van Werkhoven
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
2Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for C.H. (Henri) van Werkhoven
  • For correspondence: c.h.vanwerkhoven{at}umcutrecht.nl
Brechje de Gier
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brechje de Gier
Scott McDonald
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Scott McDonald
Hester E. de Melker
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hester E. de Melker
Susan J.M. Hahné
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Susan J.M. Hahné
Susan van den Hof
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Susan van den Hof
Mirjam J. Knol
1Center for Infectious Disease Control, National Institute for Public Health and the Environment (RIVM), Bilthoven, the Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Mirjam J. Knol
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background Registration in the Dutch national COVID-19 vaccination register requires consent from the vaccinee. This causes misclassification of non-consenting vaccinated persons as being unvaccinated. We quantified and corrected the resulting information bias in the estimation of vaccine effectiveness (VE).

Methods National data were used for the period dominated by the SARS-CoV-2 Delta variant (11 July to 15 November 2021). VE ((1-relative risk)*100 %) against COVID-19 hospitalization and ICU admission was estimated for individuals 12-49, 50-69, and ≥70 years of age using negative binomial regression. Anonymous data on vaccinations administered by the Municipal Health Services were used to determine informed consent percentages and estimate corrected VEs by iteratively imputing corrected vaccination status. Absolute bias was calculated as the absolute change in VE; relative bias as uncorrected / corrected relative risk.

Results A total of 8,804 COVID-19 hospitalizations and 1,692 COVID-19 ICU admissions were observed. The bias was largest in the 70+ age group where the non-consent proportion was 7.0% and observed vaccination coverage was 87%: VE of primary vaccination against hospitalization changed from 75.5% (95% CI 73.5-77.4) before to 85.9% (95% CI 84.7-87.1) after correction (absolute bias -10.4 percentage point, relative bias 1.74). VE against ICU admission in this group was 88.7% (95% CI 86.2-90.8) before and 93.7% (95% CI 92.2-94.9) after correction (absolute bias -5.0 percentage point, relative bias 1.79).

Conclusions VE estimates can be substantially biased with modest non-consent percentages for registration of vaccination. Data on covariate specific non-consent percentages should be available to correct this bias.

Competing Interest Statement

C.H. van Werkhoven declares financial and non-financial research support from DaVolterrra and bioMerieux; financial research support from LimmaTech; consultancy fees from MSD and Sanofi-Pasteur (all payments to the University Medical Centre Utrecht and not related to the current manuscript). All other authors report no conflicts of interest.

Funding Statement

This study did not receive any funding

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This is a secondary analysis of another study (https://doi.org/10.1101/2022.07.21.22277831) for which the research proposal was assessed by the Centre for Clinical Expertise at the RIVM. They verified whether the work complies with the specific conditions as stated in the law for medical research involving human subjects (WMO), and were of the opinion that the research does not fulfill one or both of these conditions and therefore conclude it is exempted for further approval by the ethical research committee.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Footnotes

  • Some clarifications were made in response to peer reviewer questions. No changes have been made to the analysis, results or main conclusion.

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted February 20, 2024.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Information bias of vaccine effectiveness estimation due to informed consent for national registration of COVID-19 vaccination
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Information bias of vaccine effectiveness estimation due to informed consent for national registration of COVID-19 vaccination
C.H. (Henri) van Werkhoven, Brechje de Gier, Scott McDonald, Hester E. de Melker, Susan J.M. Hahné, Susan van den Hof, Mirjam J. Knol
medRxiv 2023.05.23.23290384; doi: https://doi.org/10.1101/2023.05.23.23290384
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Information bias of vaccine effectiveness estimation due to informed consent for national registration of COVID-19 vaccination
C.H. (Henri) van Werkhoven, Brechje de Gier, Scott McDonald, Hester E. de Melker, Susan J.M. Hahné, Susan van den Hof, Mirjam J. Knol
medRxiv 2023.05.23.23290384; doi: https://doi.org/10.1101/2023.05.23.23290384

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (349)
  • Allergy and Immunology (668)
  • Allergy and Immunology (668)
  • Anesthesia (181)
  • Cardiovascular Medicine (2648)
  • Dentistry and Oral Medicine (316)
  • Dermatology (223)
  • Emergency Medicine (399)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
  • Epidemiology (12228)
  • Forensic Medicine (10)
  • Gastroenterology (759)
  • Genetic and Genomic Medicine (4103)
  • Geriatric Medicine (387)
  • Health Economics (680)
  • Health Informatics (2657)
  • Health Policy (1005)
  • Health Systems and Quality Improvement (985)
  • Hematology (363)
  • HIV/AIDS (851)
  • Infectious Diseases (except HIV/AIDS) (13695)
  • Intensive Care and Critical Care Medicine (797)
  • Medical Education (399)
  • Medical Ethics (109)
  • Nephrology (436)
  • Neurology (3882)
  • Nursing (209)
  • Nutrition (577)
  • Obstetrics and Gynecology (739)
  • Occupational and Environmental Health (695)
  • Oncology (2030)
  • Ophthalmology (585)
  • Orthopedics (240)
  • Otolaryngology (306)
  • Pain Medicine (250)
  • Palliative Medicine (75)
  • Pathology (473)
  • Pediatrics (1115)
  • Pharmacology and Therapeutics (466)
  • Primary Care Research (452)
  • Psychiatry and Clinical Psychology (3432)
  • Public and Global Health (6527)
  • Radiology and Imaging (1403)
  • Rehabilitation Medicine and Physical Therapy (814)
  • Respiratory Medicine (871)
  • Rheumatology (409)
  • Sexual and Reproductive Health (410)
  • Sports Medicine (342)
  • Surgery (448)
  • Toxicology (53)
  • Transplantation (185)
  • Urology (165)