Anotherpress release by Pfizer, this one with results from their main phase 3 trial (46,307 participants). They have followed up participants for 6 months post shot-2. The press release has some slices of data, which will certainly be released in more detail at the time of their application for full FDA approval — and presumably when they submit a journal article.
Here are the two things that caught my eye:
On the left we see more confirmation of what we knew: the superb efficacy of the Pfizer/BioNTech COVID-19 vaccine. There is now so much data that the uncertainty on the efficacy is tiny. The peak posterior probability estimate in the plot is 91%. The result is basically consistent with the previous results. It’s worth remembering that the original targets for vaccine efficacies when the development effort began in early 2020 was “anything over 50%.” The fact that this generation of vaccines is ringing the bell in the 70-90% range is really an astonishing feat.
Now to the right-hand panel. The trial has a South Africa arm (well, at 800 participants, more like a “finger”). Of these, 9 placebo-group participants became infected, and zero vaccine group-participants. Of the 9 placebo-group participants, 6 were confirmed to have been infected by the B.1.351 lineage. If you have 6 placebo infections, and zero vaccine infections, you get the plot on the right hand side. This is what the flacks who work for Pfizer’s PR department have to say about this:
In South Africa, where the B.1.351 lineage is prevalent and 800 participants were enrolled, nine cases of COVID-19 were observed, all in the placebo group, indicating vaccine efficacy of 100% (95% CI, [53.5, 100.0]). In an exploratory analysis, the nine strains were sequenced and six of the nine were confirmed to be of the B.1.351 lineage. These data support previous results from immunogenicity studies demonstrating that BNT162b2 induced a robust neutralizing antibody response to the B1.351 variant, and although lower than to the wild-type strain, it does not appear to affect the high observed efficacy against this variant.i
OK, now look at that plot. Does that say “100% efficacy against B.1.351” to you? Because to me it says “we got bupkus for evidence, since we had too few people in South Africa participating in this study.” The 90% credible region starts at 50% efficacy!
You should also be aware that the stuff about “robust neutralizing antibody response” is based on this paper, which however showed that in-vitro neutralization of B.1.351 required far more concentrated vaccine-induced antibodies than were required for other variants — I cannot understand how the how one could possibly characterize that result as “robust”. In any event, its a wet lab result, not a clinical trial. We still don’t have any quality evidence about the performance of the mRNA vaccines against the B.1.351 variant. And that has me very worried.
There’s a new journal article at the New England Journal of Medicine, detailing a Phase 1b/2 clinical trial of the AstraZeneca COVID-19 vaccine, conducted in South Africa. The principal thrust of the article is to gauge efficacy against the B.1.351 virus variant now prevalent in South Africa. The news is…not good:
This plot shows the efficacy of the vaccine, restricted to the sample of patients who developed “mild or moderate” COVID-19 (there were no “severe” cases in this small dataset) and were confirmed infected by the B.1.351 variant of SARS-CoV-2. Basically, there is no evidence of protective efficacy against the B.1.351 variant.
This is not to pile on to AstraZeneca, which is having a bad week anyway due to safety concerns. So far, no current COVID-19 vaccine has demonstrated acceptable efficacy against this particular variant (as opposed to the B.1.1.7 “UK” variant, or the P.1 “Brazil” variant). The Johnson & Johnson and Novavax vaccines also had disappointing performance against this variant. Collecting the three South Africa studies together for comparison, we see this:
None of these looks particularly good. Part of the reason the AZ efficacy plot looks much worse than those corresponding to the J&J and Novavax South Africa studies is that those studies had about 6 times more data, so the evidence for what protection their vaccines can offer is better than AZ’s evidence — the protection itself might be about the same. Also note that the J&J and Novavax studies did not single out B.1.351 cases, so there are about 5% “classic” SARS-CoV-2 cases in the above plots, and this necessarily improves their apparent efficacy with respect to the AstraZeneca result. Another confounding issue is that because of the incompetence of AstraZeneca’s vaccine manufacturing (which also led to the data issues that I discussed here), the administered doses were not all the same — the article states that vaccine recipients in the trial received “…a 0.33-to-0.5-ml dose (depending on the lot) of the ChAdOx1 nCoV-19 vaccine”, which means they don’t even have a well-controlled idea of how much vaccine they administered in this study.
Note also there is in vitro evidence that the Pfizer and Moderna vaccines will offer at best weak protection against B.1.351 (see here for Pfizer and here for Moderna).
So the story of vaccine-mediated resistance to this variant remains the same as I discussed in this post. At the moment, there is weak evidence for protection against severe disease caused by B.1.351, and no evidence at all for protection against transmission. We’re still on-track for an urgent program of B.1.351-specific vaccine booster shots (Moderna has one already in trials) as soon as they can be developed, approved, and produced. In my opinion the need for such boosters will be clear by late Summer 2021, and getting urgent by Fall.
Novavax issued another press release today, with some partial information concerning the now-completed trials, a Phase 3 trial in the UK, and Phase 2b trial in South Africa. The data is a continuation of the data analyzed in this post, and tells a similar story, although with more abundant numbers (and hence less uncertainty). There is some actual data in the press release, but there are also some efficacy estimates not backed by released data, which I can therefore not evaluate here. As usual, when the Emergency Use Authorization request gets to the FDA, a briefing document will be made public with complete trial information. I will issue another update when that happens.
Meantime, here’s what the released data for UK trial looks like:
This looks pretty good. Not that different from the preliminary results, but the constraints on efficacy are tighter, since the numbers are higher. The overall result in the left panel is extremely good (most likely value 90%), despite high prevalence of the B.1.1.7 variant. That’s the variant that is more transmissible, and possibly responsible for more severe disease with worse clinical outcomes, but which is also known not to be a so-called “escape variant” — that is, it is not less susceptible to immunity due to previous infection by “classic” SARS-CoV-2, or due to existing vaccines. So it’s not surprising that the Novavax vaccine stops it.
The “severe” disease result is shown on the right. This is what, unfortunately, is described in the press release and reported in naive media outlets as “100%” protection. From the plot it should be clear why this is an inappropriate description of the result — when you have 5 severe cases in the placebo group and 0 in the vaccine group, that’s good news, but nowhere near establishing “100% protection” — based on this data, the 90% credible region says that the protection could be as low as 40%! This kind of thing is the why it is useful to reason in terms of quantified uncertainties, as displayed in these plots, rather than with naive and deceptive point estimates. What we can say based on this data is that there is some moderately weak evidence of efficacy greater than about 40% against severe disease. If Novavax had designed their study as well as Moderna did, including many individuals at risk for severe disease, then they might have collected better evidence (as Moderna did).
Now, here’s the South African trial data analysis:
In the overall results on the left we see again the troubling effect of the South African “escape variant”, B.1.351, which has already demonstrated its ability to evade immunity produced by the Johnson & Johnson and AstraZeneca vaccines, and for which there is in vitro evidence of decreased immunogenesis by the Pfizer/BioNTech and Moderna vaccines. This result is no worse than the J&J South Africa result, but it’s not any better either. Despite the spin in the press release, it suggests that efficacy to the B.1.351 variant is likely lower than the 50% threshold limit established by the FDA for usefulness. And if the vaccines are this poor at stopping disease, they are almost certainly nearly ineffective at stopping the spread of the virus, since it is being propagated by all all the carriers who get mild or moderate forms of the disease, to say nothing of all the asymptomatic carriers.
This reinforces the point that I made in this post: The B.1.351 variant very likely largely escapes immunity from all existing vaccines. Since (1) we can expect most of the Northern hemisphere to be vaccinated by early summer, so that other variants will be under control, and (2) we know that it only takes a few months for SARS-CoV-2 to travel all over the globe (witness this time it took for the epidemic to spread from Wuhan to the rest of the world in the first place), we can expect that most COVID-19 in the Northern hemisphere will be caused by B.1.351 by sometime this year. Booster vaccines that address B.1.351 are already being prepared — Moderna’s is already in Phase 2, and there’s no doubt that the other manufacturers aren’t far behind. So, we should all get shots as soon as they are available, because they are effective at stopping the spread of classic SARS-CoV-2 and most of its variants. But we should all be prepared to get booster shots this year, as soon as the B.1.351-specific vaccines are available.
The FDA’s approval of Emergency Use Authorization of the Johnson & Johnson COVID-19 vaccine is being greeted ecstatically and uncritically by public officials and media. In my opinion, this is an indication that hardly anyone has actually looked at the data supplied by the company to the EUA committee, or read the briefing document in detail.
I wrote up a quick but careful analysis last week, which you may review here.
For present purposes, I’ll note only in passing the statistical illiteracy of journalistic celebrations of “85 percent efficacy against severe forms of COVID-19 and 100 percent efficacy against hospitalization and death” (NYT), figures that ignore both the considerable uncertainties in efficacy estimates and the carefully cherry-picked data that produces such numbers by nimble selections of geographical subregions of the trial, and by passing back and forth between results for 14 days and 28 days post-vaccine, whichever produces the better-seeming (though not actually better) result.
The point that I wish would draw notice is that the South African arm of the trial suggests that a variant crisis is imminent. The J&J vaccine is marginally effective at stopping transmission of the B.1.351 variant that is 95% prevalent in South Africa, and it’s efficacy against the severe disease could actually be as low as 50%. Here are the two relevant plots from that arm of the trial:
The right-hand figure offers some reassurance about “severe” disease (although if you think it means 80% you should not work as a science reporter). The left-hand figure, however, is extremely worrying. It says that the vaccine does nothing to restrain the spread of the virus, since all those “moderate” COVID-19 cases are shedding virus, and so are a nearly equal number of asymptomatic cases.
Here are some consequences:
B.1.135 Is The West’s Future Native Variant
It took less than 3 months for the original SARS-CoV-2 virus to travel from Wuhan to the U.S. and become an uncontrolled epidemic. It’s probably safe to assume that the freely-propagating B.1.135 variant, unrestrained by vaccination, will soon have high prevalence in the US and in Europe as well. It has mutated its way to a fitness advantage, so it will likely take over the SARS-CoV-2 genome within in a few months, probably by June at the latest.
It’s Not Just J&J’s Problem
I have no beef against J&J, and don’t mean to single the company out for criticism. There is plenty of evidence now that this is not just a J&J vaccine issue. We already know that the Novavax clinical trial had a South Africa arm that found the same thing. And South Africa has halted it’s rollout of the AstraZeneca vaccine, asserting that it “…offers minimal protection against mild and moderate cases”, as a consequence of the variant’s prevalence.
We don’t know how B.1.135 affects the efficacy of the Pfizer and Moderna vaccines, or that of the Sputnik V vaccine for that matter, since their clinical trials saw essentially zero prevalence of that variant. One may hope that since those vaccines appear to induce a more robust immune response, they may yield broader immunity against variants. But without new trials, all we can do is wait and find out.
Much of the media celebration appears to center on the ability of the J&J vaccine to prevent “severe” disease. As we saw above, even this ability is reduced in light of the advent of B.1.135. But ignoring the ineffectiveness of the vaccine at preventing transmission is madness. The probability of a mutation that increases transmissibility (or disease severity, for that matter) is proportional to the infection rate — the more cases per day, the higher the chances of a more dangerous mutation. The reason that we’re seeing proliferation of variants now, to an extent not noticeable during the March or August waves, is that the Winter wave case count eclipsed that of the other two — there have been many more mutation opportunities since October 2020 than there were before.
A vaccine is a tool for epidemic control, not a treatment or a cure. Focusing on prevention of the worst disease outcomes while ignoring transmission prevention totally misses the point. It’s tantamount to celebrating relief now, while ignoring the worse trouble to come.
A Silver Lining
The one reason that I can see not to panic now is that the next-generation vaccines that have come into being in the past year — mRNA and adenovirus vector — are reportedly very straightforward to re-target at new variants, and updated versions can be quickly produced at industrial scales, at least after current supply-chain bottlenecks are sorted out. What this means is that while everyone who gets a J&J, AZ, or Novavax vaccine now will be needing a booster by summer (and this may also be true for the Pfizer, Moderna, and Sputnik vaccines as well), at least there is reason to believe that such boosters will be widely available. For this reason, the public-health messaging on the J&J vaccine is correct: if you are offered a shot of the J&J vaccine, you should accept it. Just make sure you get a booster as soon as it is available.
The epidemic control strategy has to be to get total infection rates down (to slow the rise of newer, more dangerous variants), while rapidly developing, producing, distributing, and jabbing updated boosters to stamp out existing variants. And doing this everywhere, including in third-world nations that can’t afford to fund their own rapid-response anti-variant campaigns, because any large reservoir of transmitted virus is a potential source of newer, even more dangerous variants.
Moreover, the summer-booster messaging needs to start now. We all know how delicate public support for mass vaccination campaigns is, and how easily it can be poisoned by militantly ignorant, scientifically illiterate disinformation spread by the anti-vaxxer crowd. Those people will have a field day with rising-again infection rates among vaccinated individuals that are to be expected this summer and fall, unless there’s a comprehensive public health messaging program about variants and boosters. The sooner the better.
And reporters need to get smarter about reporting “victories” like this one, that carry seeds of future problems. When the victory turns out to be not as complete as first reported, and possibly even reversible, the consequences for public support of mass vaccination campaigns are unlikely to be good.