ABSTRACT
Causal estimands of infectious disease interventions—direct, indirect, overall, and total effects— are conventionally defined as differences in individual risk under hypothetical treatment conditions. During the coronavirus disease (COVID-19) pandemic, researchers implicitly targeted analogous estimands at the population level by comparing count outcomes (e.g., vaccine-averted deaths) to quantify public health impact of non-pharmaceutical interventions or vaccination campaigns. However, these population-level analogs of conventional estimands have not been rigorously defined. Using potential outcome notation, we introduce a population-level analog of the overall effect and partitioned it into components involving individual-level direct and indirect effects. We further identify conditions under which a population-level analog of direct effect (frequently estimated with empirical data in cases-averted or avertible analyses), can be a useful lower bound of overall effect (arguably the most relevant effect for policy-making and retrospective policy evaluation) at the population level. To illustrate, we describe a susceptible-infected-recovered-death model stratified by vaccination status. When transmission and fatality parameters do not vary and vaccine efficacies do not wane over time, cases averted via direct effect among vaccinated individuals (or cases avertible via direct effect among unvaccinated individuals) is shown to be a lower bound of population-level overall effect—that is, vaccine-averted (or avertible) cases. However, when vaccine efficacies wane, this relation may not hold for avertible cases; when transmission or fatality parameters increase over time, it may not hold for either analysis. By classifying population-level estimands and establishing their relations, this study improves conduct and interpretation of research evaluating impact of infectious disease interventions.
Competing Interest Statement
C.B. reports consulting income from Janssen Pharmaceuticals. M.L. serves as Senior Advisor to the US CDC's Center for Forecasting and Outbreak Analytics. This paper is written in his academic capacity and may not represent the views of the CDC or any government agency.
Funding Statement
J.W. was supported by the European Union's Horizon research and innovation program—project ESCAPE (Grant number: 101095619). C.B. and M.L. were supported by the SeroNet program of the National Cancer Institute (Grant number: 1U01CA261277).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
This is a simulation study with code available at https://github.com/katjia/population_level_effects.
