William M. Briggs

Statistician to the Stars!

Page 148 of 414

Spanking Good For Future Education, Income: Researchers

                   Spanked as a child?

A new peer-reviewed paper in the journal Pediatrics shows that girls are luckier than boys in avoiding spankings, that those who were spanked as children went on to greater education than those unfortunates biffed on the butts, and that those spanked had higher incomes as adults.

Yet in the paper’s abstract, we read

Harsh physical punishment in the absence of child maltreatment is associated with mood disorders, anxiety disorders, substance abuse/dependence, and personality disorders in a general population sample. These findings inform the ongoing debate around the use of physical punishment and provide evidence that harsh physical punishment independent of child maltreatment is related to mental disorders.

And then there are these summary headlines in the popular press:

The paper is “Physical Punishment and Mental Disorders: Results From a Nationally Representative US Sample” by Afifi and others. What Afifi did was to have a browse through the the National Epidemiologic Survey on Alcohol and Related Conditions and gleaned from that data those who had self-reported mental maladies and those who self-reported being spanked as a kid. This data was the result of face-to-face interviews with U.S. Census workers (surely government workers probing for intimate for-the-record details was no bar to honesty?).

Afifi, a Canuk, starts by telling us that, “The parent or caregiver’s right to use physical punishment has currently been abolished in 32 nations.” And is there a hint of lamentation when she continues, “Canada and the United States
are not included among these countries”?

Adults who answered at least “sometimes” to the question, “As a child how often were you ever pushed, grabbed, shoved, slapped or hit by your parents or any adult living in your house?” were classified as “having experienced harsh physical punishment.” Before questioning the use of harsh for something as small as being “grabbed”, let’s recall that Canada is a foreign country and they use words differently up there, eh?

A more rough-and-tumble interpretation of harsh would be “severe physical abuse, sexual abuse, emotional abuse, physical neglect, emotional neglect, or exposure to intimate partner violence” But we can’t use this definition because the poor folks who admitted to suffering this kind of “harsh” treatment “were excluded from the current sample.” Sigh.

Afifi and crew then checked off whether each remaining individual scored highly on various questionnaires for “major depression, dysthymia, mania, hypomania, any mood disorder, panic disorder with or without agoraphobia, social phobia, specific phobia, generalized anxiety disorder, posttraumatic stress disorder, agoraphobia, any anxiety disorder, any alcohol abuse/dependence, and any drug abuse/dependence.” She even grouped various of these into “clusters.” According to Tables 2 and 3 in the paper, they have 25 separate ways to be (to use a common Canadian phrase) a jelly donut short of a filling.

Anyway, the whole lot was fed into a series of logistic regression models, first adjusting for this, and then later adjusting for that. We can be grateful that Afifi eschewed the normally sacrosanct 0.95% confidence intervals and instead called “significant” those results which had p-values less than 0.01.

Unfortunately, after this promising start, Afifi forgot to adjust for all the different tests she ran. Using (for example), the Bonferroni method, to maintain that “0.01″ level of significance, actual p-values would have to be 0.0004 or lower. That means a lot of the mental maladies Afifi thought were associated with mental maladies actually weren’t. Ah, well.

Then it appears she has sometimes mixed up the idea of confidence intervals and p-values. For example, in Table 1, “Widowed/divorced/separated” are given three asterisks (supposedly significant) with a confidence interval that includes 1 (which is not significant). And this happens in Table 2, too.

There were 20,607 individuals in the database (after culling). But only 1,258, or 6%, reported having remembered, or were willing to report to a government worker, “harsh” treatment. Only 6%? Really? I emphasize this to show that measurement error is in play here, which means (in frequentist theory) that p-values are too high.

The mean age of these folks was 48.4 plus-or-minus 0.2 years. Odd, that. And, for example, of those 1,258 “harshies” just 53 reported “Schizoid personality disorder”, yet this was “significantly” higher than the “un-grabbbed.” Small numbers here.

The authors also try to forget those results which appear at the start of this post: effects which show that “harsh” treatment can be good for some (the first link recognizes this). The big question any defender (even you) of this study must answer is: what other effects were positively associated with “harsh” treatment?

It is a disservice (at the least) to go into a database and look only for what you hope to find, to ignore evidence which does not support your theory. Yet that is what appears to have happened here.

July 4th: It’s Summer And It’s Hot

[To be sung to the obvious tune]

I have a sad story to tell you
It might upset you a bit
Last night I walked on the sidewalk
And it was hot.
Pity me!

Not exactly poetry, but it has a certain je ne sais quoi to it. The pathos encapsulated by the last line brings a tear to the ocular orifices every time I sing it. Doubtless you are welling up, too.

And that’s because it’s obvious this song of woe is a tale spun from reality. It actually happened to me! Yes. Last night I did walk out onto the sidewalk…and it was hot! Heat—raw heat—covered me instantly, soaking me, drenching me in waves of unwanted electromagnetic radiation. Layers of humidity, one upon the other, attached themselves to my clothing and my skin, making me feel as slimy as a Chicago alderman.

This went on block after block. The heat did not abate; no, not even in the shade. If anything, it grew hotter. And when I finally reached the bodega in which lay the amber, life-giving well-hopped fluid which my body so desperately craved, I realized to my horror that the air in the place was not conditioned! Avert your eyes if you don’t like graphic descriptions of bodily functions—but this final serving of blistering heat actually caused me to sweat!

I tell you the truth: I have never before suffered such minor inconveniences as this.

I should have listened to the radio, to the television, to the newspaper, to the media in every form which had dispatched scores of reporters to the far corners of the city, where to a man each of them reported that it was hot. These dedicated newsmen warned me to stay inside. They cautioned me to stay where the air was electrically cooled. They told me that sure death awaited me if I dared venture forth without saturating my bodily fluids.

Not satisfied with telling me the temperature, the journalists invented something called a “heat index.” I discovered (via statistical calculation) that this was actual temperature multiplied by three. The heat index isn’t therefore the temperature, but is a number to show what the temperature would be were it hotter than it is. It is a kind of maybe temperature, a temperature that isn’t, an index which can be adjusted up or down according to the importance the journalist gives the story.

When I went out onto the street, I naturally expected to see piles of bodies which had succumbed to the heat. But there were none. This was curious. Perhaps those that were to die had died already; their corpses efficiently removed by the Soylent Corporation. Still, I began to question if there was an element of exaggeration in the repeated dire warnings.

As I walked I recalled how I had lived for three years in San Antonio, Texas (average August high of 96 with liquid skies), and again in Okinawa, Japan (a degree or two cooler, but always wetter), and never had air conditioning. As far as I could ascertain, I had not died from this lack. I also remembered that in all the cars I ever owned, there was no air conditioning. Again, this did not kill me.

There may have been lasting damage, however, because I was for years after this an atheist (I have since recovered). Anyway—full disclosure—there was an air conditioning unit in the apartment in San Antonio, but the (so-labeled by Danny Stiles) blonde bombshell with whom I shared the rent would not allow me to turn it on because she was deathly afraid of contracting Legionnaires disease, which she was sure lurked in the recesses of the machine. Yes.

Who knows where the truth lies. But if there’s anything to this global warming we hear about, it’s likely to stay summer until at least September. Worse, sophisticated computer models say the whole cycle could repeat next year.

It’s the glorious 4th. Happy Birthday, America! Be careful, it’s Summer out there and hot. And since it’s never been Summer and hot before, heed the warnings of your elected and unelected leaders and stay away from any activity in which you might find enjoyment.

Would Finding E.T. Destroy Religion? Experts

Leave it to Live Science to ask Would Finding Aliens Shatter Religious Beliefs? Answer hint: maybe yes, maybe no. Experts say so.

The discovery of life beyond Earth would shake up our view of humanity’s place in the universe, but it probably wouldn’t seriously threaten organized religion, experts say.

Ah, experts. Presumably, given the subject matter, these experts have studied other inter-, and quite possibly intra-, galactic species, watched them develop through crude animism, to monotheism, to their first NPR station, to final stage enlightened atheism, and then waited until those species noticed that there were other species who were not their species. They then gauged how the still-religious aliens in the species that discovered there were other sentient species reacted to the discovery that there were other sentient species. The experts cataloged these reactions and then moved onto the next alien species that had not yet discovered there were other alien species. Do you follow?

Even if you don’t, it’s difficult to imagine what an “expert” in this kind of case is. Doug Vakoch, director of Interstellar Message Composition at the SETI, sure doesn’t seem like one. But he’s the first “researcher” in the story quoted. He said, “I think there are reasons that we might initially think there are going to be some problems. My own hunch is they’re probably not going to be as severe as we might initially think.” Problems? Like Mormons rioting in the street? Hindus queuing up at McDonald’s? Jews clamming on Jones Beach on Saturdays?

The writer of the story, Mike Wall, reveals his biases when he opines

Religious faith remains strong in much of the world despite scientific advances showing that Earth is not the center of the universe, and that our planet’s organisms were not created in their present form but rather evolved over billions of years. So it’s likely that religion would also weather any storms caused by the detection of E.T., researchers say.

The implicit theory is that once a theist is given knowledge that the Earth is not privileged and that newts were once newtosauruses (or whatever), he should wise up and buy a Richard Dawkins t-shirt (to announce to all how much he has grown).

What Wall, and many American non-theists are unaware of, is that the vast majority of theists—most Muslims, most Buddhists, most Christians, etc., etc.—are well in advance of secularists in accepting empirical observations. And they can even show how no empirical observation can be disproof of their religious beliefs.

So it is a wonderment that Wall writes “Nicolaus Copernicus made perhaps the first powerful case for it in 1543, when his seminal work ‘On the Revolutions of the Celestial Spheres’ showed that Earth revolves around the sun, rather than the other way around.” Wall might have learned this from astronomer Seth Shostak, who sagely said, “We haven’t been the center of the universe for a while now — four centuries.”

Both Shostak and Wall appear not to have known that Copernicus was a devout Catholic priest (there is also evidence that he might have only took minor orders), that he received a doctorate in Canon Law, and that his theory of the heavens in no way “challenged” his faith. The “experts” also failed to understand that while the Earth was indeed seen as a kind of center in Western life, it was the same kind of center as the hole in the middle of your commode. Instead of a privileged place, Earth was seen as something much lower.

The nearest thing Wall could find to a true expert—and I do not jest—was science-fiction author Robert Sawyer, a man used to thinking of how people would react to the “problematic” news that other sentient beings exist. He said, “If you ask most people whether there is alien life, most people say yes.”

They do, indeed. Even to the extent of believing that they are among us, snatching and probing with merry abandon. And this is for good reason, at least in those countries with movie screens. Alien life surrounds us on screen and in print. I myself have been in a dark room with strangers, many of them surely Christians, and watched as a spaceship full of alien slaves crash land in Los Angeles (that was before all movies had to be made in New York). I can report that absolutely none of those strangers ran amok and recanted their religion.

The real question is how would scientists react were they to discover a different metaphysics. Let he that readth understand.

Statistics Mailbag

Because of my new gig and then my two-week sojourn at Cornell I am way behind in acknowledging all the emails and blog tips I have received. Nearly all stories here originate as a link from readers, and for these I am very grateful. Thank you to all who send these in and apologies for not writing back to everybody personally.

Since I have no hope of writing a separate post on all these juicy tips, here today, in no order, are some of the older ones which deserve a wide audience. I might revisit some of these later and expand on them.

General Bad Statistics

Your Brain Scan Looks Different on Mac and PC

A team…took data from 30 brain scans and analyzed them using a package called FreeSurfer…to measure the size of different parts of the brain.

They ran the software on PCs, and also on Macs running different versions of Mac OS, each time using the software to measure the size and thickness of various structures of the brain…Across most sections there was at least a 2-5 percent variation in the answers.[other] answers diverged by as much as 15 percent.

Counties that enjoyed better weather on tax day had more people sign up to become Tea Party organizers. And the paper.

What’s more, the Tea Party experiment shows that the activism catalyzed by those sunny days translates into real political influence. Politicians whose districts were sunny on tax day voted in a more reliably conservative fashion throughout 2009 and 2010. Indeed, the absence of rain in a congressional district on April 15, 2009, made its representative 8.7 percentage points more likely to vote against the Affordable Care Act. Had the weather at those early rallies been sunnier, it’s possible that Obama’s signature legislation wouldn’t have passed.

Why Women Choose Bad Boys

Women choose bad boys because their hormones make them…

Doggy daydreams: brain scans reveal Fido’s thoughts

Now we can really begin to understand what dogs are thinking. We hope this opens a whole new door into canine cognition, social cognition of other species.

Climatological Bad Statistics

Climate Change Denial in the Classroom (pdf)

models suggest…

Climate sensitivity to the lower stratospheric ozone variations Looks like another smoothing before regression “study.” A naughty no-no and guarantor of over-certainty.

Doctored Data, Not U.S. Temperatures, Set a Record This Year

To most people, the hottest temperatures ever “recorded” would imply that quality controlled thermometers registered higher readings during the past year than had ever occurred before. If you believe that this is what the National Oceanic and Atmospheric Administration (NOAA) means by hottest temperatures ever “recorded,” then you are wrong.


Email from John Cook to which we can reply Amen, brother.


I’ve started reading The Discarded Image by C. S. Lewis. Here’s a quote from it that sounded to me like something that might appear on your blog:

“In our age I think it would be fair to say that the ease with which a scientific theory assumes the dignity and rigidity of fact varies inversely with the individual’s scientific education.”

– John

People Who Believe In Heaven Commit More Crimes

This picture decreases rape rates
Heaven and hell

Some people who really ought to know better—but don’t—reported on the peer-reviewed paper “Divergent Effects of Beliefs in Heaven and Hell on National Crime Rates” by Azim F. Shariff and Mijke Rhemtulla and have concluded two contradictory findings.

  1. Belief in Heaven raises the crime rate
  2. Belief in Hell lowers the crime rate

The authors put it thusly: “Supernatural benevolence…may actually be associated with less prosocial behavior.” They say their findings “raise important questions about the potential impact of religious beliefs on global crime.”

Even so once an august news agency as CBS (which gave us today’s headline) reports “Believing if you are on a ‘highway to hell’ could impact whether or not if you commit a crime.” This matches the breathless coverage in many other places, proving once more that statistics should not be practiced without a license. Here’s what happened.

Our stalwart statistician want-to-bes took data from 1981-1984, a time long ago, a time when the Berlin Wall still held back the throngs of Westerners seeking to join the East German socialist paradise, and then they took more data from 1990-1993, and then again from 1994-199, and then still more from 1994-1999, and, would you know it?, still more from 1999-20004, and finally, not satisfied with all that, more data from 2005-2007.

The “data” consisted of answers from the World Values Surveys and European Value Surveys (different surveys, as in different). Citizens in 67 countries were asked questions on religious beliefs and other matters, such as their very own personal “Big Five Inventory of personality differences.” Only it wasn’t 67 countries. Sometimes it was 56 countries, others times 48, and yet other times 46, and then 51, 48, 47, 43, and even a lowly 39. Obviously—and the authors must agree, since they remain mute on this subject—nothing could have changed in these beliefs, not in nature or proportion, from 1981 to 2007.

They asked citizens Do you believe, yes or no, in “Heaven,” “Hell,” and “God.” They asked how many times do you attend religious services. They computed murder rates, robbery rates, and rape rates (in France in honor of film artist Roman Polanski, this was presumably modified to rape-rape rates). They even looked at car theft rates and human trafficking rates. No word on whether these measured rates matched the same years as the demographic data (I’d guess not).

And then they, yes, computed a “weighted average” for each of all these variables—even the variables “conscientiousness, agreeableness and neuroticism”—for each country.

And then? Then the real magic. All of these strange “variables were entered into a series of linear regression equations, with each crime regressed on beliefs in heaven and hell as well as all covariates.”

You know what’s coming next, dear reader. You know the thrills that await. For you, loyal visitor, know better than others the excitement that comes with tables filled with numbers with asterisks. For those asterisks lead to footnotes, and in those footnotes are found the joy of the small p-value, and in wee p-values are found promotions, glory, and honor.

To test the theories attested to above, regression models were used. Now the regression coefficient (see below if you don’t understand these metaphysical creations) between belief in Heaven and assault rate is 1.7, a number given not just one, not a mere two, but three whole asterisks! But don’t claim triumph yet, because the regression coefficient between belief in Hell and assault rate is -1.7, which also has three asterisks.

Steady on, dear one. Because if my math is right, this means the model coefficient adjustment for somebody who believes in both Heaven and Hell (which are most people who believe in either) is 1.7 – 1.7 = 0. Never mind, never mind. It’s the wee p-values that count. At least as far as publishing articles goes.

Yet there’s something screwy in my analysis, because let’s recall. This isn’t an individual’s belief in Heaven or Hell: it’s a nation’s (sort-of) weighted average of belief versus a nation’s (sort-of) weighted average crime rate. Yet this doesn’t stop our authors from writing: “Belief in hell predicted lower [overall] crime rates [coefficient -1.9, p < .001], whereas belief in heaven predicted higher crime rates [coefficient 1.9, p < .001].”

Which is still a wash if, as if very likely, the weighted (sort-of) average of Heaven believers equals the weighted (sort-of) average of Hell believers inside a country. The reason I’m probably right about this is found in their Table 1: all the positive coefficients of Heaven belief are matched by more or less equal negatives coefficients for Hell belief. Even worse for our authors’ theory, nearly all of these coefficients are similarly sized, and this is so even after “adjusting” for covariates like “Urbanicity” and “Life expectancy.”

Am I right? Gallup in 2004 reports that about 80% of Americans believe in Heaven and 70% in Hell. (The USA wasn’t in this data, of course.) And this site shows that belief in Heaven and Hell is, as we thought, nearly the same in a wide variety of countries. Significantly, it is nowhere wildly disparate.

Now a regression is a model of the central parameter of a normal distribution (ND), a distribution which is used to quantify uncertainty in some thing, like crime rate. We can write their unadjusted model like this (stick with me):

     central parameter ND for crime rate = b0 + b1Heaven + b2Hell

where we substitute in a nation’s (sort-of) weighted average of Heaven and Hell belief. If b1 = b2, as the estimates do in this paper, and if Heaven and Hell percentages are equal, as they are in most places, then the equations simplifies to

     central parameter ND for crime rate = b0

where b0 is just some number which is of no interest to anybody.

You cannot just examine b1 alone or b2 alone: you must look at both simultaneously. The entire study is thus a wash, nearly certainly a figment of (unconscious) data manipulation. Ignoring all the other ways the study goes wrong (mixing years wantonly, etc.), what would prove me mistaken is if the (sort-of) weighted averages beliefs in Heaven and Hell were not about the same, but were everywhere (or in most places) different. That is not likely, as we have seen.

And that’s just the misinterpreted statistics. Don’t get me started on discussions like this one given by the authors in defense of their theory:

Divine punishment, on the other hand, has emerged as a cultural tool to overcome a number of those limitations. Unlike humans, divine punishers can be omniscient, omnipotent, infallible, and untouchable-and therefore able to effectively deter transgressors who may for whatever reason be undeterred by earthly policing systems.

Good grief!


Thanks to Mike Flynn who suggested this (depressing) topic.

« Older posts Newer posts »

© 2014 William M. Briggs

Theme by Anders NorenUp ↑