Tertiary Source

Vaccine fears and risk tradeoffs

2008-12-26 11:28:25
This weekend's This American Life included interviews with some of the participants in this summer's measles outbreak. I learned about the outbreak from a somewhat overblown reaction from Phil Plait. From memories of Plait's older material, I expected a little lesson in conditional probability. Not finding one, I did an analysis of my own. I reached the surprising-to-me conclusion that, even with this summer's outbreak, the risk tradeoff between measles exposure and vaccine side effects is not totally unbalanced. My writeup at the time got lost in comment noise, so I'll condense it again here.

Data on infectious diseases, including measles, are compiled by the CDC. An update in August in the CDC's Morbidity and Mortality Weekly Report, coupled with activity from the CDC press room, seems to have prompted coverage from the Associated Press and other mainstream outlets, which trickled in turn to weblogs, which trickled in turn to me. One problem with blaming "antivaxxers" for the outbreak becomes apparent on reading the paper: only sixty-three cases, about half the 123 reported infections in US residents, occurred in people who were unvaccinated for "philosophical or religious reasons." At least a quarter of the infections occurred in people following the CDC's recommendations for vaccination. An effective vaccine reduces the risk of infection. Prevention can make risks negligibly small, but no process can completely eliminate risk.

Let's do some estimating. Measles seems to mostly infect people under twenty, and there are about eighty million people under twenty in the US. Of those, at 2007 incidence rates, about one in 150 will be diagnosed with autism-spectrum disorders, a rate of about 25,000 new diagnoses per year. The news in mid-2008 was that the annualized rate of measles infections had quadrupled, to 1% of the autism rate. (Not having heard of another outbreak since, I suspect the second half of 2008 had a lower-than-average measles incidence; this sort of error happens when you slice data too thinly. I have not found final numbers yet, though.)

I'm not terribly familiar with the autism-vaccine argument; my wife and I satisfied ourselves that we ought to vaccinate our children, and we did. But in my little corner of physics, people try hard not to say "there is no effect"; instead we say "we looked so many times and didn't see anything, so if there's an effect, we have such-and-such confidence that it's smaller than something." The reasonable-looking literature review linked by Plait highlights two studies in particular, one of which (Taylor et al., 1999) looked at 500 autistic children and one (Madsen et al., 2002) at 540,000 children total, all the children born in Denmark over eight years. The Madsen cohort contained 740 autistic-spectrum children. If those numbers follow counting statistics, where a measurement of N things has uncertainty ±√N, the observed division of 620±25 vaccinated autistic-spectrum children and 120±11 unvaccinated autistic-spectrum children does not differ from the division of 610 vs. 130 autistic-spectrum children expected knowing only that 80% of the children received vaccines and 0.14% received an autism diagnosis. A statistically significant effect would shift the split by fifty or sixty cases. So a concise summary of the Madsen et al. result might be:

If MMR vaccines do increase or decrease the chance of a subsequent autistic-spectrum disorder diagnosis, the risk changes by less than eight or ten percent.
Or:
At least 90% of autistic-spectrum diagnoses would have happened whether the MMR vaccine existed or not.
Either of these statements supports the hypothesis that vaccinations have no relation to autism, but not the somewhat stronger hypothesis that people who think differently live in an ignorant fairyland.

Let's give the antivaxxers the benefit of the doubt: suppose vaccines are linked to two or three percent of autism cases, a total of about 650 a year (in the US, at the 2007 rate). In that case, the roughly 8% of children who are unvaccinated would reduce the number of autism diagnoses by about fifty a year. During the period 2002-2007 there were forty or sixty measles infections each year. So a parent deciding whether to vaccinate his child on this information is choosing between roughly equal odds of rare events with very different costs:

  • A measles infection is dangerous, but also brief. Most infections last about a week; perhaps 80% have no side effects beyond the rash and fever. About 5% of infections lead to pneumonia, and somewhere under 1% lead to encephalitis or death.
  • A "triggered" autism diagnosis wouldn't present the same sort of straightforward danger. But autism is difficult. A very large fraction of autistic-spectrum children will require heroic care from their parents for their entire lives.
If those two choices were equally likely and not rare, choosing between them would be agonizing. Fortunately both are rare --- "triggered" autism is rare enough to generate serious debate about whether it ever occurs. In most cases, parents following whatever advice they stumble onto will deal with neither measles nor autism, and will feel justified in their decision.

So no [passive] participants in the vaccine-autism debate are acting unreasonably. Unfortunately, from a public-health perspective, the threshold where side effects make a vaccine "unacceptably risky" stiffens as the risk of exposure to the disease itself falls. The Madsen et al. study identified 120±11 unvaccinated autistic-spectrum children, and so could quantify the rate of autistic-spectrum diagnoses with a precision of about 10%. Improving this precision to 3% could rule out the scenario above, where the vaccination decision's positive and negative possible outcomes have roughly equal odds. But this precision would require identifying 1000±30 unvaccinated autistic-spectrum children. Using the numbers above, there are only about 2000 autism-spectrum diagnoses among unvaccinated children in the USA every year. Following this many children would be a huge undertaking. Would it ever happen?

There's a population dynamics question in here, which might or might not have a straightforward answer. If a population has some common and dangerous endemic disease, reasonable people might choose the protection of a moderately effective vaccine carrying its own risks (physical, social, financial, or otherwise). Technological advances typically reduce physical and financial costs over time; an effective publicity campaigns might adjust the social cost of a decision to vaccinate or not. How many iterations of safer/cheaper vaccines are required to eliminate an initially-common disease? Are there diseases that can't be eliminated from a population by vaccination alone, for the risk-tradeoff reasons I talk about here? And (most interesting from a public policy perspective) does the regulatory threshold where a treatment is considered "safe enough to use" change the answer?

Comment on Vaccine fears and risk tradeoffs
Name:
Email:
URL:
(I promise not to do anything unsavory with your contact information.)
You can also send regular email.

Recent questions

[none]

Older questions

Low-earth orbit has gotten full enough that collisions are a risk to consider when sending up a new satellite. How full are the Earth-Sun Lagrange points? How much could be put there?
2009-05-20 Wednesday 06:54:49
Computers have fast storage with limited space (RAM) and slower storage with fewer overall limits. How could this set of constraints change and make computing fundamentally different? How would similes about how "your brain is like a computer" change? Is there a better model for the brain?
2009-02-23 Monday 15:23:33
Children's medicines come suspended in goopy liquids. Some part of the medicine always stays behind in the measuring spoon. Do dose estimates like "3/4 teaspoon twice daily" include a correction for the left-behind part of each dose? Do different types of dosing cups make a difference? Or do other factors introduce more uncertainty?
2008-12-29 Monday 19:14:27
A stopped clock is exactly right twice a day. With some error-weighted averages, a stopped clock is more accurate on average than a clock running, say, ten minutes fast. What averages do and don't have this property?
2008-11-19 Wednesday 23:40:45
Gerrymandered Congressional districts tend to protect extremists at the expense of moderates. Will the House be more or less polarized after the turnover in yesterday's elections?
2008-11-05 Wednesday 12:39:29
If you pull two connected blobs of Silly Putty apart slowly, the thread between then stretches plastically; if you pull them apart quickly, it fractures cleanly. What sets the threshold? How sharp is it?
2008-10-20 Monday 16:16:27
The Economist claims that some 1200 people have died crossing from Mexico to the US since 1990, compared to about 300 killed trying to cross the Berlin Wall during the 28 years it was up. Fatalities per mile? Fatalities per legal crossing? Estimates of successful crossings?
2008-10-11 Saturday 09:54:20
The Economist claimed that an oil price spike on September 22 (or thereabouts) was a quirk of timing, due to some minor supply quirk that happened to happen in the last couple days to fill contracts for delivery October 1. When I hear about "the oil price" on the news, what am I hearing? Is there information in the spread between short- and long-term prices that isn't reflected in either market alone?
2008-10-03 Friday 00:57:19
You can't interact with a physical system without disturbing it, though you can ignore the disturbance in the limit where ħ is small. Similarly, you can't interact with a market for some product (by asking or buying or offering or selling) without affecting the "market price" seen by others, but you can neglect that change unless your exchanges comprise a large fraction of the market. There is some correspondence here. Clearly it'd be easy to take this correspondence as justification for saying some really dumb things. Are there any useful insights there?
2008-09-26 Friday 14:50:23
What's the pressure inside an unopened soda bottle (or can)? What's the rate at which CO2 comes out of solution at ambient pressure? How much does the bubbling change the temperature of the liquid?
2008-09-23 Tuesday 19:19:09