Statistics

Nonpolitical Images Evoke Neural Predictors Of Political Ideology?

From the paper.

From the paper.

The study

Another day, another dreary study purporting to show that the brains of “conservatives” are different than those of “liberals.”

This one hooked up to an electrical phrenology device (fMRI) 83 people1 and had them look at disgusting pictures (still shots from The View?) and other sorts of pictures and then rate them “using a nine-point Likert scale”. I’ve asked this before, but on a scale of -2 to 52.7, how good are these faux numerical scales at quantifying things like disgust or pleasantness? Never mind.

The peer-reviewed paper is by Read Montague and a slew of others in Current Biology, and has the same name sans question mark as today’s post.

To discover “conservatives”, “liberals”, and “moderates” questions were asked about how strongly participants supported items like “Biblical truth” (do no liberals believe this?) and “Foreign aide”. These were scored, the scores separated, and the results assumed infallible. Yes, really. There is no indication—which is to say, no indication—the uncertainty from these arbitrary questions arbitrarily scored and arbitrarily busted up was carried through in any analyses. But since everybody makes this mistake, we shouldn’t question it.

Anyway, the main result is no result. The three “groups did not significantly differ in subjective ratings of disgusting, threatening, or pleasant pictures”. Also turned out that “there were no significant group differences on [other] self-report measures”.

End of story? No, sir. Scientists do not let the absence of wee p-values discourage them. Out came the “penalized regression method called the elastic net” applied to the fMRI data. The theory was that even though there were no real differences in behavior, maybe the brains were different after all, which is a strange thing to think given there were no real differences in behavior. I hope my repeating that isn’t annoying.

Is this a good point to remind us the fMRI data are not pictures of the brain but are themselves output of models and heuristics (“Functional data were first spike-corrected to reduce the impact of artifacts using AFNI’s 3dDespike”, etc., etc.) which themselves are subject to uncertainty which should be carried forward in any analysis but which usually aren’t, and weren’t here? If not, let me know when is.

The analysis

I hesitate to describe the authors did next not because it’s difficult, but because I don’t think anybody will believe it. I will first remind us that we are to again lament that most statistical practice is designed around model fit, which tell the world how closely a model fits to the data at hand, and that the more models tried the better success of discovering one which fits.

The authors showed each person sets of neutral (whatever the hell that is), pleasant, threatening, and disgusting photos. There weren’t any reported differences in fMRI manipulated data between people seeing these images in the three different groups.

Next up was to form “contrasts”, which was to sort of difference the fMRI manipulated data from times when people looked at disgusting, threatening, and pleasant images against so-called neutral images. These same differences were applied to averages between “conservative” and “liberals.” The “moderates”, sad folks, were thereafter forgotten.

Incidentally, the types of people in the “conservative” and “liberal” groups were not the same: “liberals” averaged 33 years old, 39% female; “conservatives” 27 years old, 61% female. Might these biological differences account for differences in fMRI manipulated data? The authors admit (in supplementary material) that “religiousness”, age, and sex “were significantly correlated with political attitudes”. But they put this down to “false alarms” and carried on.

Now came generalized linear models—we still haven’t reached the elastic net—where for each individual “a temporal high-pass filter (128s) and order 1 temporal autocorrelation (AR(1)) was assumed”. And “The onsets for each picture subcondition (core/contamination disgust, animal reminder disgust, actual threat, no actual threat, social pleasure, nonsocial pleasure) and fixation crosses were convolved with a canonical hemodynamic response function…using a delta function of zero duration”, etc.

And that wasn’t all. “Six head motion parameters were also included in the first level GLM as covariates.” So were age and sex. Uh oh. Then they “separately examined the maps of [Disgusting – Neutral], [Threatening – Neutral], and [Pleasant – Neutral] contrasts”. Then some t-tests and some other things.

Result? “The contrasts with threatening or pleasant pictures revealed no regions surviving multiple corrections. However, in the [Disgusting > Neutral] contrast, the Conservative group showed greater activity than the Liberal group in several regions” (hint: amygdala! amygdala!). Yet, sadly, “No regions survived correction for multiple comparisons for the
[Liberal group > Conservative group] comparison.”

Another no result. So back to the computer and the “penalized logistic regression analysis”, a.k.a. “elastic net”.

“First, we extracted a map of the [Disgust > Neutral] contrast for each participant. Then, we applied an a priori mask, which was generated from the Neurosynth website”. Then they “obtained the union of meta-analytic (positively correlated and both forward and reverse inference) maps of ‘Emotion’ and ‘Attention'” and then finally formed up all the voxels into a matrix and submitted all to the “elastic net.”

That creature is so cumbrous I don’t dare describe it. But it was, in the end, fit to the “individual scores on a standard political ideology assay” and, mirabile dictu, the model fit was reasonable. But only for those time disgusting images were viewed (and leaving out “moderates”). Would young females dislike disgusting images more than older males? Just asking.

The true test: How well does their model predict political attitudes for people not used to fit the model? [INSERT CRICKET CHIRPS HERE]

The End

The authors conclude “Neuroscience has started to provide rich information about the neurophysiological processes underlying political behavior.” No, it hasn’t. It is true that a spate of flawed papers are appearing, each borrowing the mistakes of the other. Yet the authors don’t even blush when the say “Our results have important implications for the links between biology, emotions, political ideology, and human nature more fundamentally.”

Here’s where it gets scary, folks. They suggest “people are born with certain dispositions and traits that influence the formation of their political beliefs”. This seems trivially true; after all, some of us are men and some women, and that difference means a lot. But the differences the authors means refer to flawed ad hoc idiotically scaled questionnaires. How long until some bright academic produces “the” list of questions which separate the sheep from goats?

Next: “A wide range of brain regions contributed to the prediction of political ideology (Figure 3A), including those known from past work to be involved in the processing and interoception of disgust and other stimuli with negative affective valence, but also those involved in more basic aspects of attentive sensory processing”.

The mistake here is to assume we are our brains, slaves to them somehow, that these curious organs can make us do what they like, and that we have little to say about it. The lack of philosophical training tells again.

Nowhere do these authors (or any other that I have seen) betray any lack of confidence in their convoluted analyses. It seems as if—I’m just guessing—that all these authors think that because their analyses are complex they are therefore right. We need a name for this fallacy.

—————————————————————————-

1In supplementary material the authors say 12 people were removed from the analysis, but it’s not clear if these were before or after the 83.

Thanks to Rexx Shelton, Robert, and one anonymous reader for suggesting this topic.

Categories: Statistics

15 replies »

  1. How about using the currently existing Obfuscation Fallacy? After all that torturing of data just to get a significant result where there was none…….

    This type of study should be scary to all people, but those who refuse to accept reality always think they will be immune from the consequences (you know who you are) and will believe they will never end up in the same place the Jews did with the Nazis. All of these studies lead to the idea of breeding “correct” humans. There is no other use. There was a brief moment of clarity when it was realized if a gene for homosexuality was found, parents could abort the fetus if it tested positive. So, they are now trying to make homosexuality “normal” and hoping enough people will believe that the abortions won’t happen. It never works that way. A generation further down, the “genetic mistake” is again declared and bye-bye fetuses. It may sound harsh, but there is no evidence that studies like this serve any purpose other than eliminating “undesired genetics” from the population.

  2. Another day, another dreary study purporting to show that the brains of “conservatives” are different than those of “liberals.”

    They aren’t different? Then it must be the clouds liberals keep sticking their heads into that account for their thought processes.

  3. Point of information (the Urban Dictionary was no help):

    What is the meaning of “CRICKET CHIRPS”?

    Emptiness?

  4. What is the meaning of “CRICKET CHIRPS”?

    It’s a rural idiom 🙂 Means no answer gotten. IOW: the only sounds heard were crickets chirping. I think it’s only a U.S. thing.

  5. Thanks for the analysis of the paper. I am wondering whether such critiques are given in the original journal? I’m more familiar with history journals; if someone puts forward an interpretation, it generally draws criticism from several directions. Is that the case in bio-neuroscience journals? Will you send your analysis in to the journal?

  6. DAV: I actually suspect there are differences, since liberals run entirely on emotion (though I am listening to a con artist advertising on a conservative talk show tell us we are all going to “melt down” —if he’s advertising there, there may be less difference in brains than I think……) and at least occasionally conservatives run on logic. There is a sheeple verus independence difference that does seem to follow what has been identified as inborn personality traits (no link available—maybe later, I’m kind of in the middle of something). It is possible, but we would need a much, much better study.

  7. Sheri,

    It does seem that some conservatives have their heads shoved up someplace far from clouds and where the sun doesn’t shine but equally effective at muddling thinking. Fox has a couple on their staff. Maybe part of FNC’s balance & fairness policy?

    Re: slow site; strange errors

    Today I started getting bizarre errors from this site. I upgraded to the latest Firefox version and the site is now very quick and no errors. Might be temporary but I’m hoping not.

    Interestingly, I downloaded the latest and greatest not more than 15 minutes ago and I just was notified that a newer version is available.

  8. I don’t know what’s more surprising, that the paper admitted trying less complex statistics and found no relationship, or that the reviewers saw that and still thought it should be published.

    We need to bring back the honor of “we didn’t find anything, but here’s all the information from our experiments”.

  9. BTW: “CRICKET CHIRPS” is also what you hear on popular TV shows; even old ones to symbolise night-time.

    In true Hollywood style, classic TV shows like Hogan’s Heroes had the sound of chirping crickets at night time; even when there was snow on the ground.

Leave a Reply

Your email address will not be published. Required fields are marked *