October 15, 2004
CANADIANS VS. HOCKEY:
Global Warming Bombshell : A prime piece of evidence linking human activity to climate change turns out to be an artifact of poor mathematics. (Richard Muller, October 15, 2004, Technology for Presidents)
Progress in science is sometimes made by great discoveries. But sciencePosted by Orrin Judd at October 15, 2004 4:47 PM
also advances when we learn that something we believed to be true isn't.
When solving a jigsaw puzzle, the solution can sometimes be stymied by
the fact that a wrong piece has been wedged in a key place.In the scientific and political debate over global warming, the latest
wrong piece may be the "hockey stick," the famous plot,
published by University of Massachusetts geoscientist Michael Mann and
colleagues. This plot purports to show that we are now experiencing the
warmest climate in a millennium, and that the earth, after remaining
cool for centuries during the medieval era, suddenly began to heat up
about 100 years ago--just at the time that the burning of coal and oil
led to an increase in atmospheric levels of carbon dioxide.I talked about this at length in my December 2003 column. Unfortunately,
discussion of this plot has been so polluted by political and activist
frenzy that it is hard to dig into it to reach the science. My earlier
column was largely a plea to let science proceed unmolested.
Unfortunately, the very importance of the issue has made careful science
difficult to pursue.But now a shock: Canadian scientists Stephen McIntyre and Ross McKitrick
have uncovered a fundamental mathematical flaw in the computer program
that was used to produce the hockey stick. In his original publications
of the stick, Mann purported to use a standard method known as principal
component analysis, or PCA, to find the dominant features in a set of
more than 70 different climate records.But it wasn't so. McIntyre and McKitrick obtained part of the program
that Mann used, and they found serious problems. Not only does the
program not do conventional PCA, but it handles data normalization in a
way that can only be described as mistaken.Now comes the real shocker. This improper normalization procedure tends
to emphasize any data that do have the hockey stick shape, and to
suppress all data that do not. To demonstrate this effect, McIntyre and
McKitrick created some meaningless test data that had, on average, no
trends. This method of generating random data is called "Monte Carlo"
analysis, after the famous casino, and it is widely used in statistical
analysis to test procedures. When McIntyre and McKitrick fed these
random data into the Mann procedure, out popped a hockey stick shape!That discovery hit me like a bombshell, and I suspect it is having the
same effect on many others. Suddenly the hockey stick, the poster-child
of the global warming community, turns out to be an artifact of poor
mathematics. How could it happen? What is going on? Let me digress...
So, what is the true curve?
Posted by: Eugene S. at October 15, 2004 5:01 PMAs a proud Canadian, I am shocked and...thoroughly confused.
Posted by: Peter B at October 15, 2004 5:30 PMGo to http://www.john-daly.com/hockey/hockey.htm
for an analysis of the "Hockey Stick."
Here's a dirty little secret--most scientist are about as talented in computer programming as oj is at math. And I say that from my experience with astronomers, which is a VERY computationally intensive science.
Posted by: brian at October 15, 2004 5:50 PMReading the entire article is not nearly as damning as oj's excerpt.
In fact the author maintains his "faith" in human caused global warming.
Mike
brian;
Here's another dirty little secret - most programmers aren't very good at programming. How I loved code reviews when I point at some bit of code and ask "How could this possibly work?". The nonplussed expression that signified the question "how am I supposed to know?" was always a joy. Or sometimes the victim would pull his printout closer, picking at it fearfully with his eyes as if it were the simple but beautiful language of an Incan monkey god rather than code he typed up the previous week. But nothing matched the thrill of victory when their spirit would fail them and they'd ask me to explain their code to them.
Oddly, management stopped letting me do code reviews. Too Nietzchian for them, I guess.
Oh, how I miss those days when I would crush my co-workers, see them shrivel before me and hear the lamentations of their friends!
P.S. This was actually an endless source of social problems bewteen us and the California office. They were touchy feely concensus based. We were hardy MidWesterns who were just plain brutal. But we always figured it like combat training - the more you sweat in development, the less you bleed from customers.
Posted by: Annoying Old Guy at October 15, 2004 7:03 PMMike,
If you scratch the portions of the prediction model that happen to cause the hockey stick, then the predictions of 11 degree increases in temp. by 2100 go away, in which case policy like Kyoto become yet more absurd.
----
OJ,
How come you attribute the article to "Technology for Presidents". It's just "Technology Review" isn't it?
Posted by: Bret at October 15, 2004 7:08 PMYou have a point, Brian. I consider myself the world's worst programmer, and most techies I know will not argue with me about it.
Anyone who has ever actually studied climate history would know that for about 300 years of recorded history from 1000-1300 CE, the earth was significantly warmer than it is now. The earth also had a warmer period at the time of the Early Roman Empire, followed by massive droughts in the third and 4th century CE. At both junctures the earth was warmer than it is now. I guess it was all those hydrocarbons the ancient Romans and the Dark Ages Europeans were throwing into the air.
Posted by: Bart at October 15, 2004 7:22 PMThe problem cuts a few different ways. Was the original study accurate? It seems that it was not, insofar as Nature has subsequently published a correction of sorts. The MM team that discovered the errors complain that the correction is, in itself, incomplete and incorrect.
Various bits of data that would permit a complete analysis of what has happened are not being made available to others in order that the original "hockey stick" work can be properly replicated/debunked. Nature apparently is not requesting that all the original data and code be provided in order to settle things definitively and is leaving many with the mistaken impression that what is incomplete original data is, in fact, complete.
Nature's actions with regard to the MM teams efforts for publication in nature can reasonably be construed to be based on issues other than what is proper. How often do submissions gain additional reviewers during the peer review process? How often do space limits get revised downward during review in the manner that the MM submission was?
Given the central importance that the hockey stick analysis was given in the IPCC and its use in the Kyoto negotiation, signature, and ratification process, Nature has an obligation to the world to not hide behind ever shorter limits on article space to the point where truth is sacrificed to word count fetishism and there is no publication whatsoever. The lives and livelihoods of literally billions ride on us getting global warming science correct.
Put on your Jimmy Neutron pajamas, folks, the geek pajamahadeen are needed.
Posted by: TM Lutas at October 15, 2004 10:54 PMThe problem cuts a few different ways. Was the original study accurate? It seems that it was not, insofar as Nature has subsequently published a correction of sorts. The MM team that discovered the errors complain that the correction is, in itself, incomplete and incorrect.
Various bits of data that would permit a complete analysis of what has happened are not being made available to others in order that the original "hockey stick" work can be properly replicated/debunked. Nature apparently is not requesting that all the original data and code be provided in order to settle things definitively and is leaving many with the mistaken impression that what is incomplete original data is, in fact, complete.
Nature's actions with regard to the MM teams efforts for publication in nature can reasonably be construed to be based on issues other than what is proper. How often do submissions gain additional reviewers during the peer review process? How often do space limits get revised downward during review in the manner that the MM submission was?
Given the central importance that the hockey stick analysis was given in the IPCC and its use in the Kyoto negotiation, signature, and ratification process, Nature has an obligation to the world to not hide behind ever shorter limits on article space to the point where truth is sacrificed to word count fetishism and there is no publication whatsoever. The lives and livelihoods of literally billions ride on us getting global warming science correct.
Put on your Jimmy Neutron pajamas, folks, the geek pajamahadeen are needed.
Posted by: TM Lutas at October 15, 2004 10:56 PMThe "hockey stick" analysis was the prime evidence of global warming cited by the last IPCC report. Yet it claimed that there was no medieval warm period, no little ice age, and no indication of a time in the past when temperatures were warmer than the present. This is so at variance with accepted climatic records that it should have been dismissed immediately, and yet Nature doesn't even see fit to publish the criticisms because it doesn't fit in their 500 word limit!
Posted by: jd watson at October 16, 2004 4:34 AMGuess what folks. Mann cooked the data, cherry picked the interval and diddled the code.
McIntyre and McKitrick caught Mann with both paws in the cookie jar.
Nature is doing a CBS pre-internet coverup. Stonewall the evidence, hide the data.
Muller is attempting a CBS post-internet coverup. "It's fake but authentic".
Bret -- If you actually look at the article, you will see:
Global Warming BombshellA prime piece of evidence linking human activity to climate change turns out to be an artifact of poor mathematics.
By Richard Muller
Technology for Presidents
October 15, 2004
(italics mine.)
Mike --
As you point out Muller has 'faith'.
The problem with this article is that Muller buys 'Global Warming' and the Kyoto Protocal.
While he does understand that the MM paper destroys the 'hocky stick' argument he still thinks that 'careful science' will restore GW and KP to their previous glory.
The bottom line is that Muller supports Mann and is attempting to mimimise the (obviously inadvertent) error Mann made. Actually Mann uses one of the 'standard' junkscience techniques to make a pre-ordained case by abusing statistical methods.
By all means do as Bill suggests and check this out. It will be heavy sloging for some folks and it is long.
Posted by: Uncle Bill at October 16, 2004 10:05 AMIf you are a true believing dupe of GW, the science doesn't really matter. It's the faith that's important, the underlying belief structure. Everything must conform to that, somehow.
Posted by: Kris Johnsen at October 16, 2004 11:44 AMBut isn't the recent warming trend real? We see glaciers receding all over the northern hemisphere.
Why is it a northern hemisphere phenomenon (where most of the industrial activity is) and not a global one?
Posted by: Eugene S. at October 16, 2004 1:45 PMThe globe has been warming for 12,000 years, Eugene.
The issue is whether human activity is increasing the rate; or staving off the next Ice Age; or having no effect.
Nobody has any idea what the answer will turn out to be, because we do not know what the temperature is right now.
Posted by: Harry Eagar at October 16, 2004 3:08 PMHarry,
There hasn't been a straight-line warming trend for the past 12,000 years. Different centuries in the past 2000 years have been colder, and others warmer. At least that much is known.
The northern hemisphere is getting warmer. Look at the glaciers -- I know I am repeating myself -- they are receding! It doesn't take a genius to conclude that if the ice is melting, it must be of the temperature.
So, why only the northern hemisphere? Could it be because this is where most of the industrial activity is?
... please note that I am asking a question, and not a rhetorical one either. Nor am I suggesting any particular policy yet such as "Kyoto".
I would simply like to know more about the causes of warming, which may turn out to be entirely non-man-made, but I also believe it makes sense to explore how human activity affects the climate.
If the "hockey stick" is an artifact, then let the scientists step back and do a better analysis of the available data, which are plentiful.
Posted by: Eugene S. at October 16, 2004 3:36 PMEugene, I again refer you to the phenomenon in the high Middle Ages of southern Greenland actually being green enough to sustain an Archdiocese.
Posted by: Bart at October 16, 2004 4:49 PMBart, O.K.
Maybe it'll help if I bullet my questions:
- Why the northern/southern hemisphere split?
- Could it have to do with industrial activity being greater in the northern hemisphere?
There is a split between the hemispheres and climate differences are not unusual in our history. We don't have anywhere near enough data about the Southern Hemisphere to engage in serious analysis.
Given that there have been periods of our history where it has been warmer in the Northern Hemisphere than it is today, it is a safe assumption to say that current climate change involves more variables than the behavior of people. Once we correct for those other variables, then we can analyze the effect of industrial behavior on the climate.
Posted by: Bart at October 16, 2004 5:39 PMGlaciers aren't receding in the Southern Hemisphere? Says who?
Posted by: Moira Breen at October 16, 2004 10:17 PMSome in the northern hemisphere are growing.
It depends, in part, on local conditions.
It may not be a straight line warming, Eugene, but obviously the temperature in every period you want to name during the past 12,000 years has been warmer than the temperature during any period during the previous 100,000 (or more) years.
In fact, over close to 4 billion years, there has been NO TREND.
If there had been a trend, even of one-ten/billionth/deg/year, we wouldn't be here
Posted by: Harry Eagar at October 17, 2004 5:17 PMLooks like a job for CSI: Academe.
Hey, I've written code that brought full professors
to tears, but it did what I wanted. So did MM.
