Abstract
Background Infectious disease outbreaks present unique challenges to study designs for vaccine evaluation. Test-negative design (TND) studies have previously been used to estimate vaccine effectiveness and have been proposed for Ebola virus disease (EVD) vaccines. However, there are key differences in how cases and controls are recruited during outbreaks and pandemics of novel pathogens that have implications for the reliability of effectiveness estimates using this design.
Methods We use a modelling approach to quantify TND bias for a prophylactic vaccine under varying study and epidemiological scenarios. Our model accounts for heterogeneity in vaccine distribution and for two potential routes to testing and recruitment into the study: self-reporting and contact-tracing. We derive conventional and hybrid TND estimators for this model and suggest ways to translate public health response data into the parameters of the model.
Results Using a conventional TND study, our model finds biases in vaccine effectiveness estimates. Bias arises due to differential recruitment from self-reporting and contact-tracing, and due to clustering of vaccination. We estimate the degree of bias when recruitment route is not available, and propose a study design to eliminate the bias if recruitment route is recorded.
Conclusions Hybrid TND studies can resolve the design bias with conventional TND studies applied to outbreak and pandemic response testing data, if those efforts collect individuals’ routes to testing. Without route to testing, other epidemiological data will be required to estimate the magnitude of potential bias in a conventional TND study. Since these studies may need to be conducted retrospectively, public health responses should obtain these data, and generic protocols for outbreak and pandemic response studies should emphasize the need to record routes to testing.
Key Messages
- Conventional Test-Negative Design (TND) studies can be biased when follow-up of cases leads to testing and recruitment, which occurs for example during contact tracing.
- A hybrid TND estimator can eliminate this bias, if individual testing routes are recorded.
- The related bias in the conventional TND estimator can be quantified using epidemiological measures.
- If testing route data is unavailable, bias can be limited by other study measures.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work was supported by the Innovative Medicines Initiative 2 (IMI2) Joint Undertaking between European Union Horizon 2020 Research and Innovation Programme and the European Federation of Pharmaceutical Industries and Associations [EBOVAC3: grant number 800176]; Department of Health and Social Care using UK Aid funding managed by the NIHR [VEEPED: PR-OD-1017-20007]; National Institutes of Health, National Institute of General Medical Sciences [U54 GM111274]; and HDR UK Innovation Fellowship [grant MR/S003975/1 to R.M.E.]. The views expressed in this publication are those of the authors and not necessarily those of the Department of Health and Social Care.
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
revised for clarity & updated to include hybrid design that addresses the study bias issue with conventional test-negative design.
Data Availability
The results are simulation-based. All code for those simulations can be found in the repository.
