Relative risk reduction and absolute risk reduction measures in the evaluation of clinical trial data are poorly understood by health professionals and the public. The absence of reported absolute risk reduction in COVID-19 vaccine clinical trials can lead to outcome reporting bias that affects the interpretation of vaccine efficacy. The present article uses clinical epidemiologic tools to critically appraise reports of efficacy in Pfzier/BioNTech and Moderna COVID-19 mRNA vaccine clinical trials. Based on data reported by the manufacturer for Pfzier/BioNTech vaccine BNT162b2, this critical appraisal shows: relative risk reduction, 95.1%; 95% CI, 90.0% to 97.6%; p = 0.016; absolute risk reduction, 0.7%; 95% CI, 0.59% to 0.83%; p < 0.000. For the Moderna vaccine mRNA-1273, the appraisal shows: relative risk reduction, 94.1%; 95% CI, 89.1% to 96.8%; p = 0.004; absolute risk reduction, 1.1%; 95% CI, 0.97% to 1.32%; p < 0.000. Unreported absolute risk reduction measures of 0.7% and 1.1% for the Pfzier/BioNTech and Moderna vaccines, respectively, are very much lower than the reported relative risk reduction measures. Reporting absolute risk reduction measures is essential to prevent outcome reporting bias in evaluation of COVID-19 vaccine efficacy.
A critical appraisal of phase III clinical trial data for the Pfizer/BioNTech vaccine BNT162b2 and Moderna vaccine mRNA-1273 shows that absolute risk reduction measures are very much lower than the reported relative risk reduction measures. Yet, the manufacturers failed to report absolute risk reduction measures in publicly released documents. As well, the U.S FDA Advisory Committee (VRBPAC) did not follow FDA published guidelines for communicating risks and benefits to the public, and the committee failed to report absolute risk reduction measures in authorizing the BNT162b2 and mRNA-1273 vaccines for emergency use. Such examples of outcome reporting bias mislead and distort the public’s interpretation of COVID-19 mRNA vaccine efficacy and violate the ethical and legal obligations of informed consent.
Pfizer’s vaccine “may be more than 90% effective.” (Mahase, BMJ 2020;371:m4347, November 9) Specific data are not given but it is easy enough to approximate the numbers involved, based on the 94 cases in a trial that has enrolled about 40,000 subjects: 8 cases in a vaccine group of 20,000 and 86 cases in a placebo group of 20,000. This yields a Covid-19 attack rate of 0.0004 in the vaccine group and 0.0043 in the placebo group. Relative risk (RR) for vaccination = 0.093, which translates into a “vaccine effectiveness” of 90.7% [100(1-0.093)]. This sounds impressive, but the absolute risk reduction for an individual is only about 0.4% (0.0043-0.0004=0.0039). The Number Needed To Vaccinate (NNTV) = 256 (1/0.0039), which means that to prevent just 1 Covid-19 case 256 individuals must get the vaccine; the other 255 individuals derive no benefit, but are subject to vaccine adverse effects, whatever they may be and whenever we learn about them……We’ve already heard that an early effect of the vaccine is “like a hangover or the flu.” Will vaccinees who are later exposed to coronaviruses have more severe illness as a result of antibody-dependent enhancement of infection (ADEI), a known hazard of coronavirus vaccines? Is there squalene in the Pfizer vaccine? If so, will vaccinees be subject to autoimmune diseases, like Gulf War Syndrome and narcolepsy that have been associated with the adjuvant?