Statistics

Blinks As Lie Detectors

The advice on this shirt are at odds with Science.

The advice on this shirt are at odds with Science.

The holy grail of behavioral psychology is a test which determines if a person is lying. One hasn’t been discovered yet, though not because of a lack of effort.

Pretty much everything has been tried. Bumps on the head, a.k.a. phrenology, bumps in the head, a.k.a. magnetic resonance imagery, galvanic skin response, heart rate, breathing rate, stool color, sweating, nervousness, answers on proprietary questionnaires (they call them “instruments” and charge pretty pennies to view them), torture, e.g. water-boarding (yes, it’s still torture even if you undergo it for the purpose of writing about it). Even asking, “Are you lying?”

I’m guessing about the stool color.

The newest foray into fiction forecasting is eye blinking. So says Frank M. Marchak in his peer-reviewedDetecting false intent using eye blink measures” in the aptly named journal Frontiers in Psychology.

Marchak assures that “[s]ince being untruthful regarding both past and future acts includes the attribute of a desire to mislead”. That settled, Marchak collected via on- and off-line ads 54 Montanans as representatives of the entire human race.

In two extremely complicated experiments “of ecological validity”, he tracked his volunteers’ pupil diameter, blink, and eye movement using the “Smart Eye Pro version 5.4 remote eye tracker.” Results?

In both experiments…those with false intent showed a lower blink count difference, fewer numbers of blinks, and shorter maximum blink duration for questions related to their intent compared to questions related to another act for which they had no intent.

That’s a tangle, which only grows thicker when considering the experiment itself, which went like this (I’ll just do the first). People who saw the ad called a number, which was hooked to an answering machine which told volunteers to leave their own number. They were called back later, promised $25, and asked to venture to an “intake office” in some downtown building. Paperwork was filled out. And then—this is beginning to sound like a spy novel—participants were handed a slip of paper which directed them to walk to a second building in which was an “instruction room.”

Some of the volunteers were then instructed to don headphones which informed them that “they were to commit a mock crime by taking a ‘fuse lighter’ from a downstairs office in the building and providing it to a ‘contact’ after completing a credibility assessment test at another location”. They were given a photograph of the “contact.”

The remaining volunteers “heard instructions in which they were to remove a note from the door of a downstairs office and were not provided with the supplementary materials.”

More skulduggery:

In both conditions, participants exited the instruction room, walked around the block, and entered the building through a side door. They then proceeded downstairs to a basement office. Those in the truthful intent condition simply removed a sticker containing numbers from the door. Those in the false intent condition were required to enter the office and find and remove the fuse lighter. The office containing the fuse-lighter was furnished to resemble a working facility.

In both conditions, the participants exited the building through a third door and proceeded approximately 2 blocks to our laboratory to take a credibility assessment examination.

Then it got strange. Participants were debriefed with a fixed set of questions, the timing of which was painstakingly measured. For example, the “neutral” question “Do you live in Bozeman or a surrounding community?” took precisely 3005 milliseconds to hear. Not 3004 milliseconds, not 3006 milliseconds, but 3005 milliseconds because, it is presume, a one millisecond difference could make all the difference.

Besides the neutral queries, there were also out-of-the-blue questions about drugs (e.g. “Do you intend to transport illegal drugs today?” 2610 ms) and some about the bomb (e.g. “Do you plan to provide a fuse lighter to someone today?” 3060 ms).

During this grilling, the eye-scanner counted the blinks, durations of blinks, and time between blinks, and maximum blink time, both before, during, and 10 seconds after each question.

Then it got strange. The statistical manipulation of these numbers was so complex it would have put Merlin to shame. But skip that and consider the “raw” data. Two groups: “false” (fuse bomb) and “truthful” (note only) intent. For example, the average (standard deviation) maximum blink duration for neutral questions were 221.700 ms (136.474 ms) in the bomb group and 231.398 ms (123.879 ms) in the note group. The “8” in “231.398” represents a millionth of a second. There were similar results for drug and “explosives intent” questions.

Same sort of thing for number of blinks. Note group had average 6.368 blinks (SD 4.438), and bomb group had 4.467 blinks (SD 2.693) for the explosives intent queries, and similarly fewer average blinks for the other query types. What’s a thousandth of a blink? Never mind.

You can guessed what came next: frequentist hypothesis testing (after much manipulation) and wee p-values, all of which “proved” Marchak’s theory to Marchak’s satisfaction.

I have no idea what to make of this study, but I did learn this (I’ll let Marchak have the last word):

The effect of arousal on eye blink behavior has been investigated by Tanaka (1999) who examined the changes in blink rate, amplitude, and duration as a function of arousal level and found differences between a high arousal vigilance task and a low arousal counting task.

——————————————————————————-

I believe I learned of this study from Neuroskeptic @Neuro_Skeptic, but I can’t recall for sure.

Categories: Statistics

7 replies »

  1. Bill,

    You have nailed an extremely important issue.

    This area is wide open for scammers to ply their wares. And they have.

    For an overview of the “State of the art of Credibility Assessment” (lie detection, deception detection), see this presentation:

    http://my.brainshark.com/Lie-To-Me-447426595

    The biggest scam running is by a psychologist–Paul Ekman. His scam involved “research” that showed that there is a set of “universal human facial expressions” that convey exactly the same emotions in all people all the time all over the world.

    Building on this scandalously bad “research” Ekman layered on a Barnumesque flair for self-promotion. He now has a multi-million dollar contract with US Homeland Security to “teach” his “method” of, well, it’s not quite clear what his method does.

    Barnum-like huckstering:
    http://www.naturalnews.com/040849_Dr_Paul_Ekman_Lie_to_Me_facial_expressions.html#

    Like a good huckster, Ekman avoids clearly elucidating what his claims are. He now avoids any publication, instead hiding behind “proprietary” and “classified” claims for his “method.”

    But he is all over Deception Detection forums, and, under a multi-million dollar contract, his method is taught to government agents for lie detection.

    http://www.nature.com/news/2010/100526/full/465412a.html

    http://www.slideserve.com/loren/detection-of-deception-by-facial-expression

    Not quite sure how he statistically defended his original claims, but it doesn’t even hold up to a qualitative review.

    But here’s a statistical review of one of his published studies:

    http://www.biomedexperts.com/Abstract.bme/17221309/On_lie_detection_wizards

    Here is a purely, coldly analytical, academic evisceration of Ekman’s scam:

    https://www2.bc.edu/~russeljm/publications/psyc-bull1994.pdf

    Ekman just pretended he hadn’t been debunked, published a lazy rebuttal, and went back to huckstering his wares.

    There is much to follow-up here.

    All the best.

    Kent Clizbe
    kent@kentclizbe.com

  2. I would think one’s bodily reaction to lying would depend on the expected consequences and incumbent gain or loss. My reactions to giving someone a fuse lighter (or not) in this experiment are hardly going to be the same as those in an genuine interrogation where I might actually experience worry.

    The participants in this study are play-acting and know it. It’s right up there with telling someone to say 2+2=5. Not quite the same as answering “where were you when this murder occurred?” Why would anyone think responses while play-acting are in any way representative of those when lying without a script?

  3. The convoluted method of determining volunteers won’t select for weirdos, no not at all. For eye blinking you must definitely watch out for facial tics, as in Tourettes, that might mimic significant results. In fact that is probably all he is seeing. Phrenology as lie detecting? Do the bumps grow like Pinocchio’s nose or did you make this one up as well?

  4. I’m sorry but once I saw [url=http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3795311/table/T2/]table 2 [/url] I had to stop reading. There should be a cutoff for coefficient of variation (ratio of SD to mean) based on sample size. A SD that exceeds 50% of the mean for every measure (100% in one case!) in a sample of 54 says to me that individual variation was too high. I’m not advocating accepting as good any low coefficient of variation, merely rejecting as suspect any high coefficient of variation – a low coefficient of variation can be completely wrong but a 50% coefficient of variation is just too high. I wish I had something worthwhile to say about the actual article but I just cannot bring myself to read any further.

  5. FBI has studied indicators of deception for years–any benefits better than chance are very small. On average, increased eye-blink rates correlate with increased thinking about novel issues…but…sociopaths & narcissists are notorious for their unblinking gazes. Not to mention humidity effects, etc. Make of that what you will…

    REALLY INTERESTING: A small group did a pseudo-scientific eye-blink “study” (presumably on a napkin) some decades ago…they covertly measured eye-blink rates of nearby patrons in a restaurant & came up with an average blink rate. So armed they calculated the following:

    Driving at 55 mph for 100 miles the average person will have driven about seven miles with their eyes closed.

    Someone else calculated a significantly lower eyes-closed distance driven figure: http://thesquealingtire.com/blink-of-an-eye/

    Obviously, such amateur analyses are too variable to be truly meaningful and this important issue is best resolved by professionals subsidized with oodles of grant money who can calculate the averages to one-millionth of a second and whatever the correspondingly precise distance works out to be.

  6. But, one can still see through partially-blinkered eyes, so the eyeblinkdetectometer must be calibrated to detect and measure only the closed-enough-to-be-the-same-as-really-closed phase of the eyeblink. And not count when one eye blinks and the other does not. Unless the driver is blind in one eye. Lots of room for follow-up studies and research into eyeblink detection circuitry.

Leave a Reply

Your email address will not be published. Required fields are marked *