Saturday, March 13

Rant

Not Scientist

These days, I get almost all of my news from the Net. The only print magazine I still read regularly is New Scientist. (I buy Newtype every month, but they just pile up in the corner...)

Most weeks New Scientist is a great reminder that we really are living in the 21st century. It regularly reports on research and findings, not to mention feats of engineering, that would have been world-shaking just twenty years ago. It's at its strongest reporting new findings in the hard sciences, particularly in under-reported fields like materials science, and at its weakest reporting on political issues.*

This week's issue has a special report on Parapsychology. This should be a case of dynamiting fish in a barrel. But both articles - The power of belief and Opposites detract - soft-peddle scientific argument and overstate the support for ESP.

In the first case, the writer is simply taking pains to be fair, reporting both sides as though they are equal, both acting in good faith. We've all seen that before, and know where it leads. The two sides aren't equal:

After years of rancour in which the sceptics and believers stood on opposite sides of the divide, it was agreed that the only way forward was to establish some mututally agreeable standards. Sceptics agreed to ditch their presumption of artefact or fraud whenever a positive result came in;
- Not that there was any such universal assumption -
in return, parapsychologists agreed to drop all forms of special pleading
- Which they instead took to new heights -
and concentrate on getting replicable results.
- Which attempt met with singular failure, and resulted in yet more special pleading. Here's a fine example:
As we pondered this paradox, we became cognizant of a number of subtler, less quantifiable factors that also might have had an inhibitory effect on the experiments, such as the laboratory ambience in which the experiments were being conducted. For example, during the period in which the FIDO data were being generated, we were distracted by the need to invest a major effort in preparing a rebuttal to an article critical of PEAR’s PRP program. Most of the issues raised therein were irrelevant, incorrect, or already had been dealt with comprehensively elsewhere, and had been shown to be inadequate to account for the observed effects. Notwithstanding, preparation of a systematic refutation deflected a disproportionate amount of attention from, and dampened the enthusiasm for, the experiments being carried out during that time. Beyond this, in order to forestall further such specious challenges, it led to the imposition of additional unnecessary constraints in the design of the subsequent distributive protocol. Although it is not possible to quantify the influence of such intangible factors, in the study of consciousness-related anomalies where unknown psychological factors appear to be at the heart of the phenomena under study, they cannot be dismissed casually. Neither can they be interpreted easily.
Those darn skeptics! Every time they ask their nasty questions, our experiments fail! It's all their fault!

That's from a paper by PEAR - the Princeton Engineering Anomalies Resarch group. Their papers are filled with special pleading - and also with evidence for poor experimental control, misuse of statistics, and truly lousy writing style.

The second piece, however, just goes for the big lie.

What's more, ESP experiments have been replicated and their results are as consistent as many medical trials. .... In short, by all the normal rules for assessing scientific evidence, the case for ESP has been made.
This utterly untrue.

Every ESP experiment that has produced positive results has, upon closer inspection, been shown to be seriously flawed. Except in the many cases where the researchers have refused to have their experimental design reviewed by a third party.

Every experiment that has been redone with tighter experimental controls has shown a marked reduction in the strength of the result. More often that not, positive findings disappear or are reduced below the level of statistical significance.

What does Robert Matthews, writer of Opposites detract, have to say?

Despite this relentless rejection of their work, parapsychologists such as those at the Koestler unit have ploughed on in search of clinching evidence they hope will convince the scientific community. Some believe it is a waste of time because the reality of ESP has now been been put beyond reasonable doubt. Sceptics agree it is fruitless, but on the grounds that since ESP cannot exist, all positive results must be spurious. [My italics.]
This is a deliberate distortion of the sceptical position.

Skeptics are skeptical of ESP for a number of reasons. First of all, it doesn't seem to happen. That is, if you look for examples of the paranormal in everday life, you never find a clear example, only slightly odd events and strange coincidences.**

Second, almost every effect claimed for ESP contradicts established scientific laws. Now, we call the laws of science that becuase they work. They work every time, without exception. The parapsychologists are claiming exception from those laws when no such exception has been found in any other field of study.

And finally, there is the chequered history of the field itself. Well, it's not chequered so much as solid black. Matthews:

Over and over again, reputable researchers have found strong evidence for the existence of ESP in tightly controlled experiments.
This is a lie.

The entire history of ESP research has been a study in bad experimental design. Parapsychologists simply do not follow the basic rules of eliminating outside influence in their experiments.

When experiments are redesigned properly, the effects disappear.

Every time.

And since this has been the case for decades, we have to come to another conclusion: Not only is there no good evidence for ESP, but there are no reputable researchers in the field. If they were reputable, they would by now be designing effective experiments.

They're not.

So either they are staggeringly incompetent, or they are frauds. Or a combination of the two. Matthews again:

More than any other scientific discipline [Hah!] parapsychology pushes the scientific process to its limits, and reveals where its faults lie. In particular, it has highlighted that, contrary to the insistence of many scientists, data alone can never settle this or any other issue.
The blame lies not with the scientific process, but with the way parapsychologists have misconstrued it and manipulated it to their own ends. If your experiments are not conducted properly, the data from those experiments will not support your case. It is not evidence of anything.

And if you conduct poorly controlled experiments for decades, real scientists will simply dismiss your efforts as worthless.

James Randi has a prize of a million dollars open to anyone who can demonstrate any paranormal effect. Quite a number of people have tried. None of them have even passed the preliminary tests, conducted informally and with much less rigorous controls than would be used by any serious experimenter.

And what do we see from those who fail?

Well, apart from the dowsers - who seem to be a friendly bunch, suffering from just a minor case of self-delusion (something that is hardly restricted to dowsers) - apart from them, we find special pleading. Either the test design - mutually agreed upon well in advance - was wrong, or their powers - guaranteed to work under the agreed conditions - would in fact not work under the agreed conditions - or it was all the fault of those darned skeptics.

I leave it to my readers to draw the parallels between these individuals, who never let a nasty fact impinge upon their worldview, with certain political groupings.

* The editors are, frankly, a bunch of commies.

** And a lot of anecdotes. I love anecdotes. I have a special container by my desk in which I store them.

Posted by: Pixy Misa at 05:51 AM | Comments (3) | Add Comment | Trackbacks (Suck)
Post contains 1300 words, total size 8 kb.

1 "If they were reputable, they would by now be designing effective experiments." And working for the other side.

Posted by: Ted at Saturday, March 13 2004 10:50 AM (blNMI)

2 I'm not trying to come down hard on you, Ted, but there are no "sides". There's truth and then there's nonsense. Calling parapsychology a "side", IMHO, gives them more respect than they're entitled to.

Posted by: dorkafork at Saturday, March 13 2004 05:16 PM (d8Baf)

3 In what way do you think the Koestler Parapsychology tests were flawed?

Posted by: your mum at Monday, April 12 2004 03:07 AM (bAKUo)

Hide Comments | Add Comment

Comments are disabled. Post is locked.
53kb generated in CPU 0.0157, elapsed 0.1805 seconds.
56 queries taking 0.171 seconds, 352 records returned.
Powered by Minx 1.1.6c-pink.