Not a trick question: what’s the difference between a risk of one in ten million and one of two in ten million? The official answer is “Not much.” Though I would also have accepted “Almost none”, “Close enough to be the same,” and “Who would care?”
The exceptionally nervous care. They would have said “One is twice as large as the other!” That’s mathematically correct. And it sounds juicier than the banal entries. Might get somebody’s blood going if you can claim to have doubled a risk. Thus, those wanting to excite will talk in terms of relative risk.
Relative risk is the simple formula:
(Probability getting it given condition B)/(Probability getting it given condition A).
“Getting it” means meeting a criterion, such as developing or dying of some malady, but it can be anything. The conditions are the different evidences used to calculate the probabilities. Example: “getting it” means seeing a Head on a coin. Let “condition A” be “flip one coin” and “condition B” be “flip two coins.”
We deduce the probability of Head given A of 1/2, which soars to 3/4 given B (trust me). Thus the relative “risk” of seeing a Head is (3/4)/(1/2) = 1.5. Another way to say it is that the risk of a Head is 1.5 times higher for flipping two coins over just one. Easy, right?
Next suppose “getting it” is developing cancer of the albondigas. Condition B might be those exposed to chemicals in the drug coriandrum sativum (actually sold by many corporations: the FDA does not control it). Condition A are those not exposed.
Now “exposed to” and “not exposed to” are tricky. Problem is they don’t mean anything, or anything specifically. Is just a whiff of coriandrum sativum enough to count as “exposed”? Or does it take daily ingestion? If so, for how long a period and in what quantities? And what about the people “not exposed”? Presumably they were “not exposed” because they were different than the people who were “exposed.” How many ways were they different?
Is life easy by defining “exposed to” as “any exposure of any kind in any amount”, which is certainly plain enough? No, because it begs the question why the folks who did not see any exposure of any kind in any amount didn’t. Were they off on holiday? Did they eat different foods? Come from a different culture? Were they older or younger? Have variant genetics? You can go on forever—literally—and never be sure of identifying all things different between the groups.
Another twist. Suppose God Himself told us that the probability of cancer in the exposed group is 2 in 10 million and the probability of cancer in the not-exposed group is 1 in 10 million. The relative risk is 2. We could write a peer-reviewed paper which says, and says truthfully, “Exposure to coriandrum sativum doubles the risk of cancer of the albondigas.” Yet what does it mean?
Epidemiologic evidence suggests that Los Angeles is a “hot spot” for coriandrum sativum exposure. Now LA proper has about 4 million residents, some of whom will have been exposed, some not. Suppose, for the sake of argument, the population is split. And remember the Lord himself assured us the relative risk of 2 is correct.
The chance is 67% that nobody in the exposed group will develop cancer. Pause here. That’s no-body. Meaning there’s a two-out-of-three probability that not a single soul of the 2 million exposed people will get cancer. Anti-intutive? Shouldn’t be: even with a relative risk a whopping 2.0, there’s still a paltry 2 in 10 million chance of disease.
Oh, chance nobody gets it in the not-exposed group is 82%.
Now–and pay attention here—the chance that just one person of the 2 million in the exposed group develops cancer is 27%. That means there’s a 94% that either nobody gets it or just one person in 2 million does. (There’s a 16% chance just one person in the non-exposed group gets it.)
Gist is that the overwhelming probability is no more than one poor soul develops cancer in the exposed group, but that it’s more likely nobody does. Same in the not-exposed camp. Shocked?
I saved the funkiest bit for last: the chance that more people develop cancer in the exposed group is just 28%!1 Not even close to 100%, right? Even with a relative risk of 2, there’s only just over a 1 in 4 chance of larger numbers of cancer patients in the exposed group. Reflect on this. No, seriously. Reflect.
The largest chance, 59%, is that both groups will have the same number of people who develop cancer. And there is even a 13% chance that the not-exposed group will have more people who cancer than the exposed group!
I promised funky and that’s pretty funky, no? Emanates from the title: there’s a world of difference between (sensational) relative and (sober) absolute risk.
Part II: Things, unfortunately, are not always worse than we hoped.
—————————————————————–
1These are from standard calculations, where “standard” is used in the sense “everybody knows but few use them.”
This post reminded me of a recent comic that addressed the same issue of relative vs. absolute risk in a pithier manner.
http://xkcd.com/1252/
This works really well with mesothelioma. There is $30 billion dollars set aside for lawsuits. The rate of diagnosis seems to hold steady at about 3000 per year in the US. The payout seems very large versus the risk factor, but asbestos is everywhere. We all are at risk.
In Canada, cases have “doubled” : Between 1980 and 2006, the number of mesothelioma cases among men rose steadily from about 30 to 177. Over the same time period, age-standardized incidence rates also increased, from 0.7 per 100,000 to 2.0 per 100,000. (https://www.cancercare.on.ca/cms/one.aspx?pageId=52209)
The actual number of people diagnosed is about 177, according to the page.
One of my relatives was told at a government seminar that exposure to ONE strand of asbestos could cause mesothelioma. She was really upset and worried about such exposure. She, of course, had a better chance of a boulder hitting her truck (oh, wait, that did happen–she survived).
Personally, I have always loved the statistics for diabetes since it affects me. I would hear “x” increased chance of heart attack, then look at the actual numbers. Very different story with the real numbers.
davebowne,
Agreed. Send that cartoon to the EPA, would you?
This is not a comment about this topic, but rather a general statement.
William, your blog is a breath of fresh air, each and every day.
A Statistician who understands the world and knows how to write.
Someday I may even become smart enough to be a Bayesian.
davebowne,
I would go further than that cartoon. Even an order of magnitude increase in a tiny risk tends to remain tiny.
Hal44,
Aren’t you a sweetheart. Thanks very much. Good news is that we’re all Bayesians, even if we don’t admit it!
MattS,
Stick around to see the consequences.
“No, because it begs the question why the folks who did not see any exposure of any kind in any amount didn’t.”
Nooooooooooooo.
That question was raised. But nothing was begged.
My broken record comment.
It can be useful to study the dead. We do learn from find out why people die. It is very important though to remember the living.
What is the survivability ratio?
The scary part about smokers is that so many of them don’t die.
Brad tittle,
“What is the survivability ratio?”
0, all things that live eventually die.
Pingback: A Postmodern Christianity? - BigPulpit.com
Pingback: Selling Fear Is A Risky Business: Part II | William M. Briggs
Pingback: Selling Fear Is A Risky Business: Part Last | William M. Briggs
Suggestion to readers:
Look up the words, “albondigas” and “coriandrum sativum”.
You may be amused.