ABSTRACT
Introduction Despite representing only 3% of the US population, immunocompromised (IC) individuals account for nearly half of the COVID-19 breakthrough hospitalizations. IC individuals generate a lower immune response following vaccination in general, and the US CDC recommended a third dose of either mRNA-1273 or BNT162b2 COVID-19 vaccines as part of their primary series. Influenza vaccine trials have shown that increasing dosage could improve effectiveness in IC populations. The objective of this systematic literature review and pairwise meta-analysis was to evaluate the clinical effectiveness of mRNA-1273 (50 or 100 mcg/dose) versus BNT162b2 (30 mcg/dose) in IC populations using the GRADE framework.
Methods The systematic literature search was conducted in the World Health Organization COVID-19 Research Database. Studies were included in the pairwise meta-analysis if they reported comparisons of mRNA-1273 and BNT162b2 in IC individuals ≥18 years of age; outcomes of interest were SARS-CoV-2 infection, hospitalization due to COVID-19, and mortality due to COVID-19. Risk ratios (RR) were pooled across studies using random-effects meta-analysis models. Outcomes were also analyzed in subgroups of patients with cancer, autoimmune disease, and solid organ transplant. Risk of bias was assessed for randomized and observational studies using the Risk of Bias 2 tool and the Newcastle-Ottawa Scale, respectively. Evidence was evaluated using the GRADE framework.
Results Overall, 22 studies were included in the pairwise meta-analysis. Compared with BNT162b2, mRNA-1273 was associated with significantly reduced risk of SARS-CoV-2 infection (RR 0.87, 95% CI 0.79–0.96; P=0.0054; I2=61.9%), COVID-19–associated hospitalization (RR 0.83, 95% CI 0.76–0.90; P<0.0001; I2=0%), and COVID-19–associated mortality (RR 0.62, 95% CI 0.43–0.89; P=0.011; I2=0%) in IC populations. Results were consistent across subgroups. Because of sample size limitations, relative effectiveness of COVID-19 mRNA vaccines in IC populations cannot be studied in randomized trials and evidence certainty among comparisons was type 3 (low) and 4 (very low), reflecting potential biases in observational studies.
Conclusion This GRADE meta-analysis based on a large number of consistent observational studies showed that the mRNA-1273 COVID-19 vaccine is associated with improved clinical effectiveness in IC populations compared with BNT162b2.
Introduction
The global coronavirus disease 2019 (COVID-19) pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has resulted in 103 million reported infections and 1.1 million deaths to date in the United States (US) (1). In response to the pandemic, mRNA-1273 (Spikevax®, Moderna, Inc., Cambridge, USA) (2) and BNT162b2 (Comirnaty®, Pfizer/BioNTech, New York, USA/Mainz, Germany) (3), each employing novel mRNA technology, were developed and approved for the prevention of COVID-19 (4). Global phase 2/3 studies demonstrated that both mRNA vaccines given in a 2-dose series were highly efficacious at reducing symptomatic infections and hospitalizations in the immunocompetent population (5; 6).
Although immunocompromised (IC) individuals comprise only approximately 3% of the total US population (7), they account for nearly half of the breakthrough COVID-19 hospitalizations (8). While there is a range of severity across conditions at the population level, adults considered immunodeficient had 2.68-fold greater adjusted odds of being hospitalized with COVID-19 compared with immunocompetent individuals due both to the underlying IC condition and therapies used for treatment (9; 10). In 1 study, use of immunosuppression in patients with autoimmune disease resulted in 1.35-fold (95% confidence interval [CI] 1.29–1.40) greater odds of developing life-threatening COVID-19 (11).
Despite being at increased risk of COVID-19–related morbidity and mortality (10; 12-14), IC individuals and patients receiving immunosuppressive medications were excluded from participating in pivotal trials of mRNA-1273 and BNT162b2 (5; 6). Real-world COVID-19 data indicate that vaccine immune responses are generally impaired in IC populations (9; 15-17) and that vaccine effectiveness, as estimated as the odds of obtaining a positive SARS-CoV-2 test result using multivariate logistic regression models, is lower in IC versus immunocompetent individuals (18). In addition to severe COVID-19, IC populations are at higher risk of prolonged SARS-CoV-2 infection (19–26) and viral evolution (19-22; 24; 27; 28) due to poor humoral responses. These risks are exacerbated by even lower antibody responses to SARS-CoV-2 variants (29–35). IC individuals may also contribute disproportionately to SARS-CoV-2 transmission to household contacts (36). High vaccine effectiveness is therefore critically important for this population and the US Centers for Disease Control and Prevention (CDC) recommended a third dose of either mRNA-1273 or BNT162b2 COVID-19 vaccines as part of their primary series.
Influenza vaccine trials demonstrated that high dose vaccines led to improved immune responses in IC individuals compared with standard dose vaccines and suggested that a high dose vaccine offers greater effectiveness for IC populations (37–42). Although both mRNA-1273 and BNT162b2 employ the mRNA mode of action, the composition of each vaccine is different. For instance, the mRNA dosage and type of lipid nanoparticles used in the delivery system differs between vaccines. The mRNA-1273 primary series contains 100 mcg of mRNA and 50 mcg for the booster (2; 43), whereas BNT162b2 contains 30 mcg of mRNA for each primary and booster dose (3; 44). Observational studies have consistently shown differences between the two mRNA COVID-19 vaccines both in terms of immune response (15) and clinical effectiveness (45–47) in IC populations.
As SARS-CoV-2 transitions from a pandemic to an endemic state, countries are transferring vaccination programs from central government purchasing to their respective national healthcare systems, which is triggering in-depth health technology assessments to recommend the best use of available vaccines in specific populations. Several national immunization technical advisory groups (NITAGs), including the Advisory Committee on Immunization Practices (ACIP) in the US, use the GRADE (Grading of Recommendations, Assessment, Development and Evaluations) framework for identifying questions relevant to healthcare, selecting outcomes of interest and assessing their importance, evaluating the available evidence, and synthesizing evidence to develop recommendations consistent with considerations of values and preferences of patients and the society in which they live (48; 49).
This present analysis follows the GRADE framework to address the following healthcare question: Is the mRNA-1273 COVID-19 vaccine (50 or 100 mcg/dose) more clinically effective in IC populations compared with the BNT162b2 COVID-19 vaccine (30 mcg/dose)? Accordingly, we performed a systematic literature review and pairwise meta-analysis to compare COVID-19 vaccine effectiveness outcomes among IC individuals given either mRNA-1273 or BNT162b2.
Methods
Search strategy and study selection
We performed a systematic literature review in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 framework (50). The main search was conducted in the World Health Organization COVID-19 Research Database on April 14, 2022 and updated on December 19, 2022. Databases searched were MEDLINE, International Clinical Trials Registry Platform, EMBASE, EuropePMC, medRxiv, Web of Science, ProQuest Central, Academic Search Complete, Scopus, and COVIDWHO. The search strategy is presented in Table S1.
Clinical trials, observational studies, or any real-world evidence published as manuscripts, letters, commentaries, abstracts, or posters were included if they reported efficacy or clinical effectiveness outcomes in IC individuals ≥18 years of age vaccinated with mRNA-1273 or BNT162b2 within the same study. IC individuals were defined as people with immunocompromising conditions falling into the clinically extremely vulnerable (CEV) groups 1 or 2, which include solid organ transplant, solid and hematological cancers, hemodialysis, poorly controlled human immunodeficiency virus (HIV) infection, and autoimmune conditions requiring immunosuppressive therapy (51). Outcomes of interest were vaccine efficacy or effectiveness against SARS-CoV-2 infection, COVID-19–associated hospitalization, and COVID-19– associated death. Recently published systematic literature reviews on the same topic were cross-checked to ensure relevant articles were included. Studies reporting outcomes in pregnant women, current or former smokers, or physically inactive people; with heterologous vaccination schedule (i.e., mix of mRNA-1273 and BNT162b2); with only safety data; or study protocols or economic models were excluded (Table S2). Two independent reviewers selected studies following a two-level approach; a third reviewer arbitrated conflicts. Titles and abstracts were screened against inclusion criteria in level 1, followed by full-text appraisal of articles not excluded at level 1 against selection criteria in level 2.
Data extraction and quality assessment
Publication details, study and participant characteristics, vaccine type and vaccination status, at-risk condition, and clinical outcomes were extracted. Risk of bias was assessed in accordance with Cochrane review guidelines (52) using the ROB 2 tool (53) for randomized studies and the Newcastle-Ottawa Scale (54) for observational studies. Evidence was evaluated based on GRADE criteria (48; 49).
Statistical analysis
Random-effects meta-analysis models were used to pool risk ratios (RR) and calculate absolute effects as risk difference (RD) per 100,000 individuals across studies. Inverse variance weights were calculated for individual studies with the DerSimonian-Laird method (55). Chi-square testing to evaluate heterogeneity across studies was performed (56). The I2statistic was estimated (0–100%, 0% meaning no evidence of heterogeneity). Subgroup analysis was performed for patients with cancer, autoimmune disease, and solid organ transplant.
Results
Overview of included studies
Of 5,745 unique items retrieved, we identified 35 studies reporting COVID-19 clinical efficacy or effectiveness outcomes in IC individuals ≥18 years of age who received mRNA-1273 or BNT162b2 in the same study (Figure 1). Thirteen articles were excluded because the population did not meet the inclusion criteria (i.e., participants had immunocompromising conditions not included in CEV groups 1 or 2), 1-dose vaccine regimen data were reported, or the outcome of interest data were not reported in sufficient detail for analysis. Characteristics of all nonrandomized (n=21) and randomized (n=1) studies included in the pairwise meta-analysis are shown in Table 1. Overall, 190,643 and 187,813 patients received mRNA-1273 and BNT162b2, respectively. Studies included mostly US populations (n=15) (18; 45; 47; 57-68), with the remaining trials reporting data on patients from Spain (n=3) (32; 46; 69), Italy (n=1) (70), Singapore (n=1) (71), Switzerland (n=1) (72), and multiple countries (n=1) (73). Specific at-risk and IC conditions included solid organ transplant (n=6) (45; 46; 57; 67; 68; 72), cancer (n=5) (18; 45; 62; 65; 70), hemodialysis (n=3) (32; 59; 66), rheumatologic disease (n=3) (18; 47; 73), multiple sclerosis or other neurological autoimmune disease (n=2) (61; 71), inflammatory bowel disease (n=1) (63), primary immunodeficiency with functional B cell defects (n=1) (64), hematological disorders (n=1) (69), and HIV infection (n=1) (72). Two studies did not specify the IC condition (58; 60). Individuals received ≥2 doses of mRNA-1273 or BNT162b2. Data on 2-dose regimens were considered if reported (n=15) (18; 45; 46; 57; 59; 61; 63-69; 72; 73), otherwise data from 3-or 4-dose regimens (n=7) (32; 47; 58; 60; 62; 70; 71) were used. Of studies reporting data from 2-dose regimens, outcomes were assessed ≥14 days after the second dose (n=13), ≥7 days after the second dose (n=1) (63), and other timepoints (n=1) (66). Timing of outcome assessment relative to the second dose was not specified in 3 studies. Variants of concern were delta (n=6) (18; 45; 46; 65; 67; 69), delta and omicron (n=2) (62; 71), delta and beta (n=1) (59), pre-omicron variants (n=1) (47), and omicron only (n=1) (58). Eleven studies did not directly specify the variant assessed (32; 57; 60; 61; 63; 64; 66; 68; 70; 72; 73).
Searches were first performed on April 14, 2022 followed by an update on December 19, 2022. * Databases searched include ICTRP, EMBASE, EuropePMC, medRxiv, Web of Science, ProQuest Central, Academic Search Complete, Scopus, and COVIDWHO. ** Includes internal documents from Moderna and recently published SLRs. COVID-19, coronavirus disease 2019; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; SLR, systematic literature review; WHO, World Health Organization.
Risk of bias assessment found no serious risk of bias for 17 studies (randomized, n=1; nonrandomized, n=16) and serious risk of bias in 5 nonrandomized studies primarily due to the lack of description of comparability between cohorts or adjustment for confounding factors (Table S3; Table S4).
SARS-CoV-2 infection (randomized study)
Only 1 and 2 laboratory-confirmed, symptomatic SARS-CoV-2 infections occurred in the BNT162b2 and mRNA-1273 arms, respectively, of a single randomized controlled trial (RCT; RR 2.05, 95% CI 0.19–22.42; RD 499, 95% CI −1,137 to 2,136) (72). The small number of events led to uncertainty around the estimates of effect and no association between mRNA vaccine type and risk of SARS-CoV-2 infection was found in this RCT. Evidence certainty was downgraded from type 1 (high) to type 3 (low) for imprecision and limited evidence (Table 2; Table S4).
SARS-CoV-2 infection (nonrandomized studies)
Of the 17 nonrandomized studies reporting SARS-CoV-2 infection, mRNA-1273 was associated with a statistically significant reduction in the risk of SARS-CoV-2 infection compared with BNT162b2 (RR 0.87, 95% CI 0.79–0.96; P=0.0054; Figure 2). The RD (95% CI) of mRNA-1273 versus BNT162b2 was estimated to be 412 fewer SARS-CoV-2 infections (from 665 fewer to 160 fewer). Heterogeneity between studies may be considered substantial (I2=61.9%). The certainty of evidence was graded as type 4 (very low) for imprecision and indirectness due to varying outcome definitions (Table 2; Table S3).
Relative risks of clinical effectiveness outcomes for mRNA-1273 versus BNT162b2 COVID-19 vaccines in IC populations are shown. CI, confidence interval; COVID-19, coronavirus disease 2019; IC, immunocompromised; SARS-CoV-2, severe acute respiratory syndrome coronavirus 2.
Analysis of 4 studies each reporting SARS-CoV-2 infection in patients with cancer (45; 65; 69; 70) found that mRNA-1273 was associated with significantly reduced risk of infection compared with BNT162b2 (RR 0.73, 95% CI 0.57–0.92, P=0.0088; RD −346, 95% CI −598 to −94, P=0.0071). Similar findings were observed in 4 studies assessing patients with autoimmune diseases (RR 0.67, 95% CI 0.52–0.88; P=0.0032; RD −455, 95% CI −1,209 to 298) (47; 61; 63; 71). No association between mRNA vaccine type was found for the 4 studies reporting SARS-CoV-2 infection in solid organ transplant recipients (RR 1.05, 95% CI 0.87– 1.26; RD −93, 95% CI −573 to 386) (45; 57; 67; 68). No evidence of heterogeneity was observed between any of the studies (I2=0% for all subgroups). As in the overall analysis of SARS-CoV-2 infection, the certainty of evidence was graded as type 4 (very low; Table 3).
Hospitalization due to COVID-19
mRNA-1273 was associated with a significantly lower risk of COVID-19–associated hospitalization versus BNT162b2 in the 9 studies included in the overall analysis (RR 0.83, 95% CI 0.76–0.90; P<0.0001; Figure 2). The RD (95% CI) of mRNA-1273 compared with BNT162b2 was estimated to be 60 fewer hospitalizations due to COVID-19 (from 140 fewer to 20 more). No evidence of heterogeneity was observed between studies (I2= 0%). The certainty of evidence for this outcome was type 3 (low) due to inclusion of nonrandomized studies and imprecision (Table 2; Table S3).
In 2 studies reporting hospitalization in patients with cancer (18; 45), mRNA-1273 was associated with a significantly reduced risk of hospitalization compared with BNT162b2 (RR 0.54, 95% CI 0.37–0.79; P=0.0013; RD −585, 95% CI −1,655 to 485). No association between mRNA vaccine type and COVID-19–associated hospitalization was found for the 3 studies each reporting hospitalization in the subgroups of patients with autoimmune diseases (RR 0.97, 95% CI 0.70–1.35; RD −103, 95% CI −1,661 to 1,456) (18; 71; 73) or solid organ transplant (RR 0.91, 95% CI 0.78–1.06; RD −147, 95% CI −816 to 522) (45; 46; 68). No evidence of heterogeneity was observed between any of the studies for the subgroup analysis. The certainty of evidence in all subgroups was graded as type 3 (low; Table 3).
Death due to COVID-19
Of the 4 studies reporting COVID-19–associated mortality (46; 57; 66; 67), mRNA-1273 was associated with a significantly reduced risk of death compared with BNT162b2 (RR 0.62, 95% CI 0.43–0.89; P=0.011; Figure 2). mRNA-1273 was estimated to lead to 56 fewer deaths associated with COVID-19 (from 559 fewer to 446 more) compared with BNT162b2. No evidence of heterogeneity was observed between any of the studies (I2=0%). The certainty of evidence was rated as type 3 (low) due to inclusion of nonrandomized studies (Table 2; Table S3). Grading was reduced for imprecision and increased due to the strong association in RR.
COVID-19–associated death was assessed only in the subgroup of solid organ transplant recipients (46; 57; 67). In these 3 studies, mRNA-1273 was associated with a significantly reduced risk of death compared with BNT162b2 (RR 0.56, 95% CI 0.37–0.84; P=0.0049; RD −3,528, 95% CI −12,002 to 4,945). No evidence of heterogeneity was observed between any of the studies in this subgroup (I2=0%). The certainty of evidence was type 3 (low) due to inclusion of nonrandomized studies as well as imprecision and limited evidence (Table 3).
Discussion
In this systematic review and pairwise meta-analysis of 22 studies, we found that mRNA-1273 was associated with a significantly lower risk of SARS-CoV-2 infection, hospitalization due to COVID-19, and COVID-19–associated mortality compared with BNT162b2 in adults with a broad spectrum of severe immunocompromising conditions. The certainty of this evidence was type 4 (very low) for the SARS-CoV-2 infection outcome and type 3 (low) for the COVID-19– associated hospitalization and death outcomes (Table 4). As all included studies were pairwise comparisons between mRNA-1273 and BNT162b2, the research question was not biased by differences in time period assessed, population, viral variants within each study. When outcomes were assessed in subgroups, mRNA-1273 was associated with significantly lower risk of SARS-CoV-2 infection and COVID-19–associated hospitalization versus BNT162b2 in patients with cancer. Compared with BNT162b2, mRNA-1273 was also associated with a significantly reduced risk of SARS-CoV-2 infection in patients with autoimmune diseases and COVID-19–associated death in solid organ transplant recipients.
IC individuals have a high burden of COVID-19 due to characteristics of their underlying disease or immunosuppressive treatments that impact their ability to mount productive immune responses as well as increased susceptibility to severe COVID-19 (30). Physicians may seek to optimize COVID-19 vaccine type, timing, and number of doses to improve outcomes in IC patients (32). RCTs are ranked highly in the hierarchy of evidence; however, studying comparative efficacy with adequate power would require enrolling a prohibitive number of IC patients. Therefore, the research question can only be assessed using large real-world databases where individual medical and pharmacy information is available.
Limitations of this systematic literature review were that non-English studies were excluded, and publication bias was not assessed in the meta-analysis. Inherent to the GRADE framework, evidence certainty is initially set to either high if the included studies are randomized studies or low if they are observational studies. As all but 1 of the 22 studies included in the pairwise meta-analysis were nonrandomized, the maximum certainty of evidence achievable in this meta-analysis was low despite the high number of observational studies and consistency of results. The pairwise meta-analysis was also limited by inconsistent outcome definitions across studies as well as differences in covariates between studies. For example, the vaccination scheme (2 vs 3 doses; booster) differed between studies, with a mix of primary series (100 mcg vs 30 mcg) and booster (50 mcg vs 30 mcg) pairwise comparisons included in the meta-analysis. Variants of concern changed over time, with risks of hospitalization and death (74) and vaccine effectiveness differing by variant (75). Vaccine effectiveness of 2-dose regimens could only be shown for the delta variant, whereas the omicron variant required a 3-dose schedule. Other sources of bias inherent to observational studies, such as prescribing differences by risk of severe COVID-19 and ability of patients to choose the mRNA vaccine type, could not be accounted for in this meta-analysis. In addition to differences in mRNA dosage between mRNA-1273 and BNT162b2, other differences such as the lipid nanoparticle delivery system and mRNA translation efficiency may also have impacted clinical effectiveness between vaccines.
Our meta-analysis of observational studies showed that mRNA-1273 (50 or 100 mcg/dose) was associated with a significantly reduced risk of SARS-CoV-2 infection, COVID-19-associated hospitalization, and death due to COVID-19 when compared with BNT162b2 (30 mcg/dose) in IC populations. Based on the findings, vaccinating IC individuals in the United States with mRNA-1273 instead of BNT162b2 would prevent an additional 60 and 56 hospitalizations and deaths per 100,000 individuals, respectively. Considering the limited availability of data from RCTs and to provide needed clinical decision-making guidance, our results showed that mRNA-1273 offers better clinical outcomes compared with BNT162b2 in vulnerable IC populations.
Author Contributions
XW and KH designed and performed the systematic literature review and meta-analysis, and critically evaluated the manuscript. AS, LEP, AR, and AK designed and performed the systematic literature review and critically evaluated the manuscript. PS and SV collected data and critically evaluated the manuscript. MTB-J and NVdV conceptualized the article and provided oversight and critical evaluation of the manuscript. All authors contributed to the article and approved the submitted version.
Disclosures
XW, KH, PS, AK, and SV are employees of ICON plc, a clinical research organization paid by Moderna, Inc., to conduct the study. AS is an independent epidemiology consultant/director of Data Health Ltd, which provides health data consultancy services, and was paid by Moderna, Inc., to conduct aspects of this study. LEP is an employee and owner of Data–Driven LLC and AR is a contractor of Data–Driven LLC, a research organization paid by Moderna, Inc. to conduct aspects of this study. MTB-J and NVdV are employees of Moderna, Inc. and hold stock/stock options in the company.
Data Availability
All data produced in the present work are contained in the manuscript.
Funding
This study was funded by Moderna, Inc.
SUPPLEMENTAL MATERIALS
Acknowledgments
Writing assistance was provided by Erin McClure, PhD, an employee of ICON (Blue Bell, PA, USA) in accordance with Good Publication Practice (GPP3) guidelines, funded by Moderna, Inc., and under the direction of the authors.