Berkeley Surface Temperatures: Released

by Judith Curry

The new surface temperature dataset developed by the Berkeley group is now available, along with four manuscripts that have been submitted for publication.

For background on the Berkeley Earth Surface Temperature project, see this previous post.  Richard Muller’s congressional testimony was discussed here.

Information on the new data set can be found on the Resources page at the Berkeley Earth Surface Temperature web site.

The papers

The group has submitted four papers for publication:

  1. Berkeley Earth Temperature Averaging Process
  2. Influence of Urban Heating on the Global Temperature Land Average
  3. Earth Atmospheric Land Surface Temperature and Station Quality in the United States
  4. Decadal Variations in the Global Atmospheric Land Temperatures

The fact that my name appears as second author on some of these papers is attributable to my last name starting with the letter “C”.  The group has taken a “team” approach to authorship on this set of papers.  My contribution to these papers has been in the writing stage and suggesting analyses.  I have not had “hands on” the data, one of the reasons being that I do not have funding to do any analysis.

Here are my summary comments on the papers.  I think the most significant paper is the Berkeley Earth Temperature Averaging Process, where Rohde et al. have introduced a new method for analyzing the data that appears to me to be a substantial improvement over existing methods.  That said, I suspect there is still considerable research still to be done in this area.  The Urban Heat Island effect paper is a nice study, and based upon the reporters’ questions, seems to be the primary paper of interest.   Is this paper the final word on the UHI issue?  Probably not.  I will be interested in the reactions to this paper, since UHI is a contentious issue.   The decadal variability study is very provocative (this is the paper for which I had the greatest input), but IMO the study needs to be extended back further in time.  The Surface Station quality paper shows nothing surprising, but I understand that Anthony Watts is raising a concern over the paper.

In summary, there are no particularly surprising results here.  The papers are initial steps in analyzing the data set, and the verdict on these particular papers will be given by others who do subsequent analyses.

The BEST PR strategy

In my relatively minor role in all this, I have had virtually no input into the BEST PR strategy.  I have encouraged making the data set available as soon as possible.  They were reluctant to do this before papers had been submitted for publication, and cited the problems that Anthony Watts had with releasing his surfacestations.org dataset before papers were accepted for publication. IMO, two of the papers (decadal and surface station quality) should have been extended and further analyzed before submitting (but that very well may be the response of the reviewers/editors.)  I agree that it is important to get the papers out there and not be scooped on this by others, especially since Muller and other team members have been giving presentations on this.  I have no problem with posting the papers before they are accepted for publication, in fact I encourage people to post their papers before publication.

In terms of how effective the team’s overall PR strategy has been, that is a subject that is certainly open to debate.  But my impression is that the group has been honest brokers in all this in terms of trying to improve our understanding of the surface temperature data, while maximizing the impact of the data set and their research.

The spin

The press embargo on this lifts today at noon Pacific time.  I suspect there will be pretty widespread media coverage on this, with both sides of the debate spinning this to suit their purposes.  I have  had queries from several journalists, to whom I probably did not provide any usable sound bites. Lets see how it plays out.

Note, the Economist published its article at noon EST, the link is here.

Anthony Watts has a post here.

Given that these two posts are already up and I quote nothing from the press release, I will go ahead and post this now.

JC summary:

Although the results of the analysis aren’t particularly surprising relative to previous analyses, I think the BEST project is very important given the importance of the surface temperature data set and the problems that have been associated with the CRU and NASA data sets, not to mention their disagreement.  The BEST group is comprised of some extremely distinguished scientists (including Nobel Prize awardee Saul Perlmutter), and this topic has benefitted greatly from the examination of this problem by physicists and statisticians who were prepared to take a fresh look at this problem.

I am honored to have been invited to participate in this study, which I think was conducted very well.

In concluding, I will remind everyone that the REAL problem with the surface temperature data set lies with the ocean data.  I hope that the Berkeley group will be able to extend their efforts to include ocean data.

I will provide updates with MSM and blog articles on this as I spot them.

Updates:

960 responses to “Berkeley Surface Temperatures: Released

  1. Thank you Judy.

    • We already knew temperatures have been rising since the last Little Ice Age (~1300 to 1870).

      The real question now is whether or not:

      a.) CO2 caused the recent part of this general trend [Consensus government science, Al Gore, the UN’s IPCC, etc.], or

      b.) World leaders used global climate change to take control [1], remove the right to self-government [2], and rule through tyranny [3].

      Near the end of the Little Ice Age, Thomas Jefferson recognized how very fragile self-government is:

      “I regret that I am now to die in the belief, that the useless sacrifice of themselves by the generation of 1776, to acquire self-government and happiness to their country, is to be thrown away by the unwise and unworthy passions of their sons, and that my only consolation is to be, that I live not to weep over it.” [2]

      1. “Deep roots of the global climate scandal (1971-2011)”
      http://dl.dropbox.com/u/10640850/20110722_Climategate_Roots.pdf

      2. “Thomas Jefferson’s letter to John Holmes (22 April 1880)”
      http://teachingamericanhistory.org/library/index.asp?document=461

      3. George Orwell’s 1949 book on tyrannical government, “1984”
      http://www.online-literature.com/orwell/1984/

    • RICHARD A. MULLER booms: “The Case Against Global-Warming Skepticism: There were good reasons for doubt, until now.

      There are plenty of good reasons why you might be
      Are you a global warming skeptic? . . .

      However not until the very end does he admit:

      Global warming is real. Perhaps our results will help cool this portion of the climate debate. How much of the warming is due to humans and what will be the likely effects? We made no independent assessment of that.

      I find it Muller’s article repugnant in that he raises the straw man that “skeptics” say long term global temperature has not been warming. No “‘skeptic” scientist that I know of says that global temperature has been not been rising since the Little Ice Age. Muller builds a lot of publicity over the equivocation that “global warming” referring to temperature only versus “anthropogenic warming”.
      Denis Ables responds

      Any credible skeptic will respond to Muller’s “study” with “So what?” Generally speaking it’s been warming since the bottom of the little ice age, in the late 1600s. That’s some 200 years before the beginning of our industrial revolution. The skeptic’s issue, whether man is responsible for much of this warming, remains intact.

      James Dillingpole rebuts: “Global Warming is Real”

      What is going on is exactly the kind of utterly reprehensible dishonesty and trickery I anatomise more thoroughly in Watermelons. . . .
      best [warmists] can do now is resort to the kind of risible semantic ruse like this deliberate conflation of “global warming” with “man made global warming”.

      The two concepts are entirely separate: all sceptics believe in “global warming” (depending on what time scale you use); what they doubt to various degrees is the “man made” element. Richard Muller has crassly fudged this distinction to make a point which has nothing to do with science and everything to do with gutter politics.

      Marc Morano summarizes critiques of Muller

      Morano further summarizes how all the major evidence is turning against the warmists.

      Lets get back to objective evaluation of the evidence, rather than “science by opinion article.”

  2. Read what you write Judith! A PR strategy! Did Bohr have a PR strategy, or Maxwell, or Dirac.

    The BEST PR strategy is not the best PR strategy because it became so important as to become visible. It’s THE news, as you can read at WUWT. And a total failure: science takes once again the back seat, and who cares if BEST does it for visibility rather than politics?

    Your results and your work have just been buried by your team. Congratulations! /sarc

    • It seems to me that at this point, getting any controversial paper published is a political struggle. BEST (heh!) if it be in the full media spotlight. This may be unfortunate, but the political aspects have been true for years, it’s only the media spotlight that’s new.

      Editors of whatever journal(s) these papers have been submitted to will know that their deliberations and decisions, no matter how secret right now, will eventually be exposed to the full glare of public scrutiny. IMO it’s not very good, but better than the available alternative.

    • I don’t think this is supposed to be new science; it’s supposed to be cleaning up old science. It’s actually less exciting than that; it’s dotting the ‘i’s and crossing the ‘t’s. It’s more like an accounting report. I can’t think of an historical parallel in science.

      • @P.E….

        I can’t think of an historical parallel in science.

        Something of an indictment of itself: Science ought to be full of peer-reviewed reports of replication of results. In the case of models, both other teams with the same models, and other teams with different models.

        I’m not talking about just climate science here, All scientific results should be replicated one way or another.

    • Yes, et cetera.

      Did Newton have a PR strategy?

      Galileo?

      Copernicus?

      Archimedes?

      And what about the first guy who discovered fire?

      • Did Newton have a load of blowhards on blogs accusing him of fraud?

        Galileo?

        Copernicus?

        Archimedes?

        if WUWT & Co (“Surface Temperature Records: Policy Driven Deception?”) hadn’t played on smearing the surface records BEST wouldn’t even exist.

      • And why would you say that so much time and energy is being expended by so many people in trying to discredit some unimportant sceptic blowhard?

      • Because “skeptics” overplayed it, even deluding themselves in many cases. If Muller hadn’t fallen for the propaganda too and so decided to investigate the matter all those “skeptic” smears would have been left standing.

      • And why would you say that some unimportant skeptik blowhard, whoever that is, expends so much time and energy discrediting so many people?

      • Why would you worry?
        Since when has some insignificant blowhard’s opinion counted for jack-schi**??

      • And much more to the point, why should Muller & co worry about some insignificant blowhard’s opinion? I mean, it’s not as if policymakers and people that matter pay any attention to them, is it?

      • Since when feigned humility and rhetorical questions and mindreading counted for (insert your favorite dysphemism)?

      • Why are you losing sleep over it? What do you care?

      • Peter317,

        Why do you think I’m losing sleep over this?

      • Willard, if you have no dog in the fight then why do you bother commenting here?

      • Peter317,

        I opened my browser this morning to let you know I was going to think about that question:

        > Why do you care?

        I believe that this is a good question and is worth reflecting. But I am not sure what you have in mind. There are lots of things to care about, as should be obvious by reading the comment threads.

        Your last question seems to presume that one must “have a dog in the fight” to care about these debates. I fail to see why this must be so, but even supposing you’re right it depends on whose dogs and which fights.

        I do have dogs and I do have fights. You can click on my name and look around my tumblog to see for yourself. There is a FAQ where I compiled some answers.

        I’ll think about your question. I’ll try to come up with an answer that I hope will satisfy us. And I’ll post it in my FAQ.

        That being said, suppose I simply reply that I can afford to have an eccentric hobby. How would you react to that answer? Please be as honest as you see fit.

        Best,

        w

      • As usual you make idiotic analogies. Blogs did not show up casting sceptical eyes on climate science as soon as it came into existence. If Man, Hansen and his ilk were not that ready to go policy hunting with half baked ideas the science would not have moved into the realm of politics..

  3. I wonder if the timing of this pre-publication media blitz is directed at the release of Donna Laframboise’s book discussed on the prior thread?

    Ever hear the term “the medium is the message?” Here is how it is described on Wkipedia:

    “Hence in Understanding Media, McLuhan describes the “content” of a medium as a juicy piece of meat carried by the burglar to distract the watchdog of the mind. This means that people tend to focus on the obvious, which is the content, to provide us valuable information, but in the process, we largely miss the structural changes in our affairs that are introduced subtly, or over long periods of time.”

    Is there a better description of the CAGW movement’s use of mass media to effect policy?

    • I wonder if the timing of this pre-publication media blitz is directed at the release of Donna Laframboise’s book discussed on the prior thread?

      Indeed – whenever information conflicts with my viewpoint, I also always turn to conspiracy and corruption as the most likely explanation. I mean, of course, there’s abundant evidence that explains the “timing” of this pre-publication – but why let facts get in the way of a good conspiracy theory?

    • You may want to check a dictionary on the actual meaning of “conspiracy and corruption.” But given the lack of effort (other than lots of typing) that you put into most of your comments, I will save you some time. Neither one is synonymous with public relations and the use of public media, which is what McLuhan was describing.

      But thanks for reading anyway.

    • Well, I DO think that whoever released the Climategate files and emails did it just before Copenhagen for the same reason you imply. And it did its job well. It has been nearly two years of the warmists being back on their heels. Now it is our turn to be back on our heels a bit, while they thumb their noses at us.

      To quote Churchill, “This is not the end. This is not even the beginning of the end. But it IS the end of the beginning.”

      The war goes on…

    • I wonder if GaryM’s wondering has anything to do with BEST’s results.

    • I wonder if the timing of this is directed at

    • I find the timing and the full-court press – along with Muller’s “no need to be a skeptic anymore” op ed in the WSJ – just a little too coincidental for my comfort level. And (I could retrace my steps to find link if required, but I think it was the Press Release on their site) one of the pieces I came across indicated that BEST is sufficiently confident of the outcome of the journal peer-review that they anticipate inclusion in AR5!

      How convenient and presumptuous is that, eh?!

      If BEST is truly committed to “transparency” and input from the wider community, why on earth did they choose to take this particular route – rather than follow Judith’s example of circulating a draft and requesting input – before submitting for publication, not to mention going to the MSM!?

      Very decent of BEST to make data etc. available for wider scrutiny, supposedly in parallel with “peer-review” process. But (pardon my skepticism), is this not a perfect set-up for dismissing any wider community criticisms if the “official” peer reviewers give the papers their blessings?!

      And since you mentioned The Delinquent Teenager…, Gary, maybe someone could point Mandia and Gleick to Canada’s National Post, where Peter Foster could show them how a real and credible book review:is written:

      Peter Foster: A thoroughly political body

      ‘The Delinquent Teenager’ shows IPCC far from objective science
      […]
      In a meticulously referenced and deservedly praised page-turner, Ms. Laframboise, an accomplished journalist who turned to the skeptical blogosphere, demonstrates how the IPCC is a thoroughly political organization. Far from objectively weighing the best available science, it cherry-picks egregiously to support its main objective: to serve its government masters. Its lead authors are not the world’s leading scientists but frequently wet-behind-the-ears graduates, and/or ardent activists. They are also selected on the basis of gender and country “diversity” rather than expertise. The organization, Ms. Laframboise demonstrates, has also been thoroughly infiltrated by environmental NGOs, in particular the World Wildlife Fund.

      [Foster concludes:]

      Her conclusion is that the IPCC process is irretrievably compromised and should be scrapped. However, the IAC review is among those documents now buried as this corrupt organization continues under the same conflicted leadership. The Delinquent Teenager should be required reading for all those who, like something out of Animal Farm, bleat or oink that “the debate is over.” Ms. Laframboise leaves us in no doubt that a ­debate has never even taken place.

      Oh, and this edition of the NP also includes the first of two in a series of excerpts from The Delinquent Teenager…

      • ..maybe someone could point Mandia and Gleick to Canada’s National Post..

        Thereby adding 10% to NP’s readership. ;)

  4. Oops – posted on the wrong thread earlier:

    Too funny: From Anthony’s post:

    And, The Economist still doesn’t get it. The issue of “the world is warming” is not one that climate skeptics question, it is the magnitude and causes.

    Apparently, like Judith, Anthony has some difficulty in reading the comments posted by “climate skeptics” at his website.

    • Jesus, Joshua, you really are this dense.

      • Really?

        Doubt that “the world is warming” aren’t posted in numerous comments here and at WUWT on a daily basis?

        Yeah – I guess I am dense, because I could swear I’ve seen such comments often. I guess I’m either mistaken and actually haven’t read them, or those comments are actually false-flag comments posted by “warmists.” Sorry for my confusion, hunter.

        I’m sure that we will see post after post by “skeptics” in complete agreement with the BEST findings that the “world is warming.”

      • Joshua, Anthony is right. Magnitude and causes. And I would add time scale and significance. I see post after post by skeptics about it.

      • Edim –

        I see many posts from skeptics that focus on magnitude and cause also – but I will repost from the previous thread:

        I read numerous posts: (1) Questioning that there is a valid mathematical trend of warming over the past 50 years, and (2) that consequently, the estimates of recent warming by the “climate community” are incorrect.

        The BEST report indicates both a valid mathematical trend of warming and (essentially) agreement with the estimates of the “climate community.”

        The group estimates that over the past 50 years the land surface warmed by 0.911°C: a mere 2% less than NOAA’s estimate.

        Posts in disagreement with the BEST findings are constant and ongoing – and have been for years. To suggest otherwise is disingenuous.

        No doubt, there are some “skeptics” who accept the scientific estimates that are consistent with those (essentially) confirmed by BEST.

        But to characterize “climate skeptics,” as a group, to be in agreement with the idea that the “world is warming” can only be done through a process of highly motivated reasoning.

      • Posts in disagreement with the BEST findings are constant and ongoing – and have been for years.

        BEST hasn’t been around for years.

      • P.E. –

        In disagreement with BEST’s findings.

      • Joshua,

        (1) Questioning that there is a valid mathematical trend of warming over the past 50 years

        I question magnitude (and causes) of the warming trend over the past 50 years. I am still not convinced that the trend is not somewhat overestimated (UHI or human local warming). Even if we accept that real, non-local warming is for example 0.6 °C (over the past 50 years), that’s all causes (net). We don’t know how much of that is caused by anthropogenic CO2. It could be 0.5, 1.0 or 0 °C. Yes it could be zero.

        Climate skeptics as a group? I don’t think so. By the way, the world is cooling over the past 8000 years.

      • Joshua, you have your issues reversed. What the trend has been is a big question. Whether there has any warming is a different issue.

      • Edim I cannot count the number of times I have had to argue with skeptics about whether it has warmed or not. Only to see them turn around and talk about the LIA.

      • “Edim I cannot count the number of times I have had to argue with skeptics about whether it has warmed or not. Only to see them turn around and talk about the LIA.”

        I think most think that the climate has warmed since the Little Ice Age.
        And there were glaciers which were formed during the LIA- hence it’s name. Not all of those glaciers which formed during during LIA have melted.
        There some articles out there which say within 50 year or so a glacier which formed during LIA will have completely melted. Though because variation, no doubt glaciers formed from the last Ice age or maybe the one before that will also melt. As will some glaciers form during the LIA won’t completely melt within 50 year or 100 years.

        We are in a warming period. You are either in warming period or a cooling period. Cooling are marked by most glaciers advancing. The LIA ended when most glacier stopped advancing and began retreating.
        In terms of the interglacial period we been in for 10,000+ years we at around the average temperature or below average temperature- the warming we are measuring is a recovery from unusual cold period called the Little Ice Age.

      • Steven Mosher,

        Whether it has warmed or not (or cooled) depends on time scale, magnitude and significance. It has cooled over the last 10 ka, 8 ka, 5 ka, 4 ka, 2 ka and probably over the last 1000 years. The coldest point of LIA was very likely the coldest point for the last ~10 ka. It has warmed since that point and nothing unusual has happened over the last 50 years. Solar activity points to an upcoming period of cooling (sc 23, 24 and maybe 25 are all weak cycles). After that who knows? Maybe Kim?

      • Heh, rising slowly toward the light. The globe is more likely to cool than to warm. If we can change the odds to warmer, why don’t we? Blow CO2 on dem Bones. Shake, rattle that coal.
        ==============

      • Joshua

        You said it was off topic in a previous thread but its certainly not in this one.
        Question-During which decade did the Earth start warming (around 1900 or so according to Giss. but you give your own answer)
        Question -During which decade did this rise turn from natural to man made.
        thanks
        tonyb

      • tony –

        I answered you previously. (because I wouldn’t want you to think me obstinate). But no probs, I’ll repeat.

        As for a valid warming trend, I’ll go with what Judith has indicated

        7. I think everyone in the room agrees that the climate has warmed over the last 50 years, for whatever reason: we saw plots of land atmospheric temperature, marine atmospheric temperature, sea surface temperature, and (from Prof Svensmark) ocean heat content, all with a rising trend.

        JC comment: there should be 100% agreement on the sign of the temperature change, although there is some room to debate the actual magnitude of the increase.

        http://judithcurry.com/2011/05/24/what-we-agree-on/

        As for when warming turned from natural to man-made, I’m a bit more agnostic, but I am not inclined to dismiss the opinion of the vast majority of experts in the field: controlling for natural variables, the warming trend over the last few decades is 90% likely to be more than 50% anthropogenic. I do remain somewhat “skeptical,” however – that the uncertainty might not be greater than captured in that statement.

      • TonyB,

        Yes the warming started around 1900, or so. That’s a fair enough statement. That’s what we see in Mann’s hockey stick too. Mann’s graph isn’t just about the existence or otherwise of the MWP.

        You ask when the warming turned from natural to man made. The warming of the early 20th century is usually assumed to be mainly natural – meaning that the ‘turn’ was mid 20th century. That is an assumption which may not be correct. Besides CO2 concentrations starting to rise, there were large scale changes in land usage at that time which had their effect on climate too.

        Incidentally, any chance of the Berkeley group taking a look at the longer term temperature record? It would be good if we could finally get agreement on the temperature record of the last millenium too.

      • Nah, Joshua, you are putting forth a straw man argument.

        The question is not has it warmed up since the little ice age. The question is whether it warming due to mankind and the method that is causing the warming.

        Do some skeptics say it isn’t warming? Yes. Do some warmist (actually a lot ) say it is not only warming but the warming is increasing based on computer simulation? Has there been an appreciable warming in the last 12 years?

        Nope, playing the straw man card doesn’t work.

      • goodspkr –

        What “straw man?”

        The question is whether it warming due to mankind and the method that is causing the warming.

        You say that there is one question (through your use of the definite article). I say that there is more than one question.

        The problem with some “skeptical” argument, IMO, is that they lack clarity. On the one hand some “skeptics question the validity of assessments that show an increased rate of warming over the past 50 years, [so that’s question #1], and that assign a value to that warming [that’s question #2] that seems significantly greater than previous warming under similar conditions [that’s question #3] under similar conditions save the influence of anthropogenic CO2.

        Yet on the other hand, some of those same “skeptics” say that they don’t question whether the globe is warming. I think if you consider that a bit, you’ll see a logical problem: If you don’t think the assessments that show warming are valid, how can you not question whether the world is warming?

        BESTs work addressed some of the issues that some “skeptics” (who obviously doubted whether the world is warming – despite whether they might proclaim otherwise) had with the previous assessments of warming.

        It is what it is. All-in-all, a relatively minor part of the big picture. As such, the question of attribution [that’s question #4] was not intended to be addressed by the BEST analysis – as the scientists involved have been quoted. But for those “skeptics” who based their “skepticism” on question #1, #2, or #3 (and I have seen many), BESTs work should be relevant.

        Assuming you accept BEST’s analysis as valid, then what remains is the question of attribution – but as such, then what has to be answered is what is the variable that has increased the recent rate of warming to the extent shown in the BEST analysis. The vast majority of climate scientists think that the most likely explanation is the correlated increase in anthropogenic CO2 emissions – based to a large degree on a sophisticated analysis of the physics of how CO2 in the atmosphere interacts with sunlight. If you have another differential variable to explain the recent rise in the rate of warming, I’d love to hear about it.

        But if you reject BEST’s analysis – then it stands to reason that you are not one of those “skeptics” that agrees that the world is warming.

        The problem with some “skeptics” is that they don’t seem to realize that you can’t have your cake and eat it too.

      • PeterB in Indianapolis

        Joshua,

        While there are a few people who think that ALL data sets are so fudged up that “all warming has been purely fabricated” the vast majority of posters at WUWT, here, and elsewhere all pretty much agree that the Earth has warmed something on the order of 0.8 to 1.0 degrees C since 1850. Skeptics question how much of this has to do with the emergence from the little ice age vs. how much of this has to do with human emissions of carbon dioxide. If you could swear that you have seen comments “often” that indicate that no warming whatsoever has occurred since 1850, I don’t really know what to tell you other than (???).

        Even skeptics realize that had there been no warming whatsoever since the tail end of the little ice age, we would all still be really uncomfortable right now, and still be suffering from famines and disease. So, in short, I suggest you do a LOT more reading of what the VERY common skeptical position actually is.

        And yes, in anticipation, I am absolutely certain that you can find, copy, and paste at least several examples of comments which are in favor of the “no warming has actually happened at all, it is all merely data manipulation” theory. As I said earlier, such posts do exist, and if your bias is to look for them and single them out, then yes, you may be under the impression that they reflect the majority of skeptic claims.

        Here is a brief summary of what most skeptics (especially those who understand the scientific method) believe:

        1. There has been on the order of 0.8 to 1.0 degrees of warming since 1850.

        2. Bad data quality and bad “handling” have probably caused some error in the exact calculated rise, and in the slope of the rise.

        3. Calculating a “global average temperature” is probably a futile (and possibly a meaningless) exercise, but for now it’s what we have.

        4. Some portion of the global temperature rise is completely natural emergence from the little ice age, and some may be due to increasing greenhouse gas emissions, but we haven’t seen any real nuts and bolts analysis attempting to show what percentage is due to what. We have merely been subjected to claims that “virtually 100% of the warming is unexplainable without the increase in CO2 emissions; therefore virtually 100% of the warming MUST be due to the increase in CO2 emissions.” This is clearly nonsense, because in order to believe that we would be forced to believe that we never would have emerged from the little ice age without the increase in CO2 emissions.

        5. Depending on just how skeptical the commentor is, he/she may believe that nearly 0% of the warming is due to CO2, and nearly 100% is due to natural causes. Most skeptics do actually believe that at least some percentage of the warming probably IS due to CO2 emissions (though not all)

        You can see MANY similar posts on virtually any “luke-warmist” or skeptical site. Unfortunately you make the same error that the majority of the BEST press releases are going to make. You assume that the majority of skeptics believe “there has been no warming at all since 1850”. Let me assure you, the majority of skeptics are damn glad we are not currently as cold as we were at the tail end of the little ice age, and you should be glad of it as well.

      • Peter –

        Even skeptics realize that had there been no warming whatsoever since the tail end of the little ice age,

        I have no idea where this comes from. I never speculated on what “skeptics” think about temperature trends since the little ice age.

        You assume that the majority of skeptics believe “there has been no warming at all since 1850″

        I have made no such assumption, and I can assure you that no matter how hard you try, you will find no comment of mine that rests on such an assumption.

        My point is that Anthony’s statement, that “skeptics” don’t doubt that the “world is warming” is not consistent with a significant number of comments I read in the “skeptical” blogosphere.

        There are two kinds of comments that would apply. One would be of the type you address in your post – that no warming has occurred since 1850. I don’t know how many such posts one might find, but I have no doubt that they would be fewer in number than two other kinds of posts that I read often.

        The fist of those two other kinds of posts refers to a recent more time reference. For example, we can find quite a few posts that say something very much to the effect of: “The warming has stopped.” or “There is global cooling, not global warming.” These types of statements would be in contradiction to Anthony’s statement, and those of many other skeptics, when they say that “Skeptics don’t doubt that the world is warming.” Our illustrious host, herself, as said that she doesn’t know any “skeptics” who doubt the sign of recent temperature trends (it is positive over the past 50 years) – so your reference to data from 1850 is largely irrelevant.

        The second of those two other kinds of posts are those which say that the analyses of temperature trends from the “climate community” are invalid. If someone believes that to be true, then there would be no basis for not doubting that the “world is warming,” as a belief otherwise would be founding on no evidence.

        2. Bad data quality and bad “handling” have probably caused some error in the exact calculated rise, and in the slope of the rise.

        3. Calculating a “global average temperature” is probably a futile (and possibly a meaningless) exercise, but for now it’s what we have.

        The qualified language you use here “probably” is to be commended – but I think that if you read many comments in the “skeptical” blogosphere, you will find that such qualified language is definitely different than the language, if not most opinions expressed. It isn’t valid to characterize the opinions of “skeptics” as a group using language that is decidedly different than the language “skeptics” use to express their opinions.

        We have merely been subjected to claims that “virtually 100% of the warming is unexplainable without the increase in CO2 emissions; therefore virtually 100% of the warming MUST be due to the increase in CO2 emissions.”

        You will note that the IPCC says that it is 90% likely that more than 50% of recent warming is attributable to anthropogenic CO2. That language is distinctly different than the claims you are attributing, as a group, to those you disagree with in respect to climate change.

        Read David W’s post above regarding discrepancies between land and satellite data. There you will find a “skeptical” opinion that is not internally inconsistent, and that clearly lies outside of Anthony’s characterization (rather than, as we see “skeptics” doing often – hiding behind a trivial statement such as “The world is warming AND cooling”).

        As much as I appreciate you sharing your perspective, your description about what “skeptics,” or “most skeptics” believe does not account for the evidence I see when I read sites such as WUWT or this site. What people say is more instructive in that regard than how you describe what they say.

        5. Depending on just how skeptical the commentor is, he/she may believe that nearly 0% of the warming is due to CO2, and nearly 100% is due to natural causes. Most skeptics do actually believe that at least some percentage of the warming probably IS due to CO2 emissions (though not all)

        There are clearly some “skeptics” who have this opinion, and who post comments that are entirely consistent with that opinion. This is the opinion that Anthony suggested that this viewpoint is uniformly characteristic of “skeptics.” My experience shows me that assessment is inaccurate at two levels. First, I read many posts that are outright in contradiction to that viewpoint. Second, I read many posts that state such viewpoint as an underlying belief – but where the accompanying argument is inconsistent with that underlying belief. Again, if you do consider the “climate community’s” analyses of temperature data to be invalid, then you have no reason to believe that: there is a trend of warming (although limited), and consequently, there is no reason to believe that anthropogenic CO2 is explanatory for any % of recent warming (because you have no valid analysis to prove any recent warming has taken place).

      • Great work Joshua, I admire your patience and energy.

    • So if one loony commenter says something on Anthony’s site, that has to be his position? What does that say about some of the comments in alarmosphere sites? Or OWS?

      • Maybe Joshua is thinking of one of those sites where the moderators delete all comments they don’t agree with.

      • So if one loony commenter says something on Anthony’s site, that has to be his position?

        “One loony commenter.”

        Too funny.

        And allow me to ask, when Anthony posts breathlessly about a snowstorm in the Sierras, or a seal showing up in Boston Harbor, is he doing so to underline his belief that “the world is warming,” but he only questions the attribution and extent?

        Of course, that last question asks for speculation – and reasonable disagreement is understandable.

        But the notion that the phenomenon can fairly be described as “one” commenter is clearly false.

        And I’ll further add that I don’t judge such comments to be “loony.” That is entirely your assessment, not mine.

        I judge them (usually) to be a product of motivated reasoning. I have seen many logically constructed arguments that conclude the world isn’t warming. Not “lunatic” in the least. But the conclusions seem (often) to clearly be derived from a motivated process of reasoning.

      • You’ll have to ask Anthony about what his intent is with some of his threads. He goes off on a lot of non-climate related tangents. A few days ago, Willis had a thread about hitchhiking to Grants Pass. It was Willis’ version the Hitchhiker’s guide to the Galaxy or Zen and the Art of Motorcycle Maintenance, but it had nothing directly to do with the climate. I think one of the reasons why his site is #1 in readership is that in some ways, it’s more like a nerd magazine than a climate blog.

        Sometimes an article is just an article.

      • Joshua,

        How do you feel about the constant stream of marginal papers in marginal journals and the fear-mongering based on them that you see in the news on a daily basis?
        Stories that state that a freak winter storm are fully consistent with global warming and that this or that disease “could be” worse in 100 years due to global warming or insisting that tropical storm frequency is worse and is definitely due to global warming? Don’t you ever just roll your eyes and say “Oh brother”? I agree there are a few people on here with no scientific background and some will say there is no warming at all. But this may be more a reaction to the constant hype in the other direction. I think when looking at the data, most people agree the planet has been warming for hundreds of years and don’t really dispute warming in general but rather its causes and the extent they will go up in the future and whether this will be a good thing or a bad thing (depends on how much they go up) and how to address the issue. The stories Anthony posts about harbor seals or what-not are simply his rebuttal to what we see in the news every day. He does not think the world is drastically cooling.

      • Bill –

        I think when looking at the data, most people agree the planet has been warming for hundreds of years and don’t really dispute warming in general but rather its causes and the extent they will go up in the future and whether this will be a good thing or a bad thing (depends on how much they go up) and how to address the issue.

        Polls show that the majority of Tea Partiers – the majority of whom believe that they are very well-informed about climate science, to the point where they say they don’t need any more information to inform their opinion (and I’ll note that David H. has said their superior knowledge about climate change is “documented”) – say that the globe isn’t warming.

        Now – that doesn’t speak to the readership of this site or WUWT per se, but there is at least some degree of crossover (the exact amount is unknown, but many have expressed allegiance with Tea Party-like ideology), and certainly, if you include Tea Partiers in your categorization of “skeptic,” then it is fair to say, I think that in fact, a reasonably significant % of “skeptics” doubt that the globe is warming (according to a recent poll, @50+% Tea Partiers, @30% Republicans, @15% independents, and @8% Dems).

        Now – I think there are some problems with the polls, and their results by shouldn’t be considered as precisely accurate. But I do think that there is a substantial amount of evidence that: (1) a significant % of “skeptics” think that the globe isn’t warming and, (2) a not negligible % of commenters at sites like Climate Etc., and WUWT do not think that the globe is warming.

        In sum, I think that statements like Anthony’s and similar statements by Judith that skeptics as a group don’t doubt that the world is warming are demonstrably false.

      • And allow me to ask, when Anthony posts breathlessly about a snowstorm in the Sierras, or a seal showing up in Boston Harbor, is he doing so to underline his belief that “the world is warming,” but he only questions the attribution and extent?

        Isn’t this Watts guy a TV weatherman, and don’t TV weathermen live off of anecdotes? Long term climate change is the opposite of anecdotal information.

      • Don’t Malthusians always dress up their doom in fancy formulas that always work, right up until reality happens?
        WHT, you believers are the ones confusing anecdotes about every snow storm, every drought, every rain every hurricane as *proof* of AGW.

      • WHT, you believers are the ones confusing anecdotes about every snow storm, every drought, every rain every hurricane as *proof* of AGW.

        That’s what I mean. Between the fundies who believe in “God’s will” to explain everything and the rest of the populace lacking intuition on statistics and thus easily enthralled by a hole-in-one, we often have a tough job explaining the obvious.

      • “The issue of “the world is warming” is not one that climate skeptics question, it is the magnitude and causes.”

        A. Watts 2011

        “Instrumental temperature data for the pre-satellite era (1850-1980) have been so widely, systematically, and uni-directionally tampered with that it cannot be credibly asserted there has been any significant “global warming” in the 20th century.”

        A. Watts 2010.

        http://scienceandpublicpolicy.org/images/stories/papers/originals/surface_temp.pdf

        First line of the summary. What a difference a year makes! I wonder what the Watts 2012 position is going to be?

      • Joshua is a self-appointed hall monitor.
        He decides what is right and wrong, and issues firm notes to be taken home to those he flatters himself sa busting.
        If they do not bring back signed notes, he calls his mommy.

      • It’s clear that Joshua is as transparant, precise and complete in his reasoning and writing as anyone who ever was! It’s just your awful bad luck that you appear to be utterly blind to this. A clear case of ‘pearls for the swine’ it seems…

      • Joris,
        Oddly but not surprisingly, you sound like a sock puppet for our dear Joshua.
        I will gladly stick with the opinion shared by many here, and let Joshua and his sock puppets play with themselves.

      • I’m rent with jowls of jocularity.
        ==============

      • You do seem to appeal to the opinion shared by many, hunter.

        Would that be a consensus, by any chance?

      • Joshua

        Thanks-it’s sometimes difficult to follow a thread because of the nesting. I agree with the 50 years but what about the hundreds of years of warming before that?
        tonyb

      • tony –

        I agree with the 50 years but what about the hundreds of years of warming before that?

        Well – since we do seem to agree about what the data show over the last 50 years, and accordingly, since we apparently agree about the mathematical validity of the analysis of those data as represented by BESTs analysis – then your question is an important one, now isn’t it?

        Take a look at this video.

        http://berkeleyearth.org/video/

        That video shows that the nature of the warming over the last 50 years is dramatically different than the warming for hundreds of years prior. My assumption is that the forces at play that increased temps in the hundreds of years prior to the last 50 have still been at play during the last 50 years, and that in the last 50 years the increasing rate of rise is attributable to some other forcing. Unless some other factor is offered to explain that difference, then I think the explanation that it is 90% probable that more than 50% of the recent warming can be attributed to anthropogenic CO2 emissions seems logical (although I’m not entirely convinced about the level of certainty that statement implies).

    • As far as that goes, there are occasional “stone cold” comments here. Does that make Judith a “stone cold climate denier”? Are you participating on a “stone cold” Tyndall-denying website?

    • Don’t worry josh, you seldom post/troll-bait on topic anyhow.

    • Oh no! Josh has resurfaced on another thread with the same post that he used in a lame attempt to derail the last thread. Pathetic. You got issues, Josh-ua.

  5. Hi Judy – I encourage you to document how much overlap there is in Muller’s analysis with the locations used by GISS, NCDC and CRU. In our paper

    Pielke Sr., R.A., C. Davey, D. Niyogi, S. Fall, J. Steinweg-Woods, K. Hubbard, X. Lin, M. Cai, Y.-K. Lim, H. Li, J. Nielsen-Gammon, K. Gallo, R. Hale, R. Mahmood, S. Foster, R.T. McNider, and P. Blanken, 2007: Unresolved issues with the assessment of multi-decadal global land surface temperature trends. J. Geophys. Res., 112, D24S08, doi:10.1029/2006JD008229. http://pielkeclimatesci.files.wordpress.com/2009/10/r-321.pdf

    we reported that

    “The raw surface temperature data from which all of
    the different global surface temperature trend analyses are
    derived are essentially the same. The best estimate that has
    been reported is that 90–95% of the raw data in each of the
    analyses is the same (P. Jones, personal communication,
    2003).”

    Unless, Muller pulls from a significanty different set of raw data, it is no surprise that his trends are the same.

    • Same crap, different day(SSDD).

    • actually they did…..why not read the paper first?

      • “We obtained this estimate by choosing 2000 sites randomly from a list ofapproximately 30,964 temperature recording stations world-wide that had not been used by NOAA, GISS, or HadCRU.”

      • Yes, and they got a different result. Look at fig 1 (we are talking about paper 4, “Decadal variations”) and there is a clear cooling over the last decade in the black BEST graph whereas the other 3 just show a levelling off.

    • Unless, Muller pulls from a significanty different set of raw data, it is no surprise that his trends are the same.

      Assuming they used the same data (which apparently they didn’t, at least for some results), it would indeed not be surprising, if we assume that urbanization or siting quality do not have a large effect on trends.

      Which I think was precisely the point of contention.


      • if we assume that urbanization or siting quality do not have a large effect on trends.

        sometimes for amusement I go to the Weather Underground site and pull up all the weather stations in my area, there are 22 of them reporting currently. As I write this post the lowest is 55.7F out in the boonies at a State Agriculture research center and the highest is 61.3 which is located in the middle of town near the maritime center. There are about 4 miles from each other as the crow flies. Other stations near the water vary from 57.3 – 61. Two of the stations located on different barrier islands read in the 57 degree range so it is not just the ocean effecting the Maritime Center Station. All are within 5 miles of the center.

        So please tell me how you derive a .1 or .2 degree per decade warming using these again. Maybe I am just missing something in the way you guys do trends. Since what is in the country now will be urban 5 to 10 years from now, the UHI effect is constantly increasing, at least where I live.

      • What they want is to eliminate that 5.6 degree difference from the trend. The problem isn’t urban heat, it’s the effect of urban heat in distorting the overall trend data.

      • . I read the BEST Station Quality tentative paper from the link over at Watts site. I suppose I was unclear as to my doubts so let me rephrase my concern on station readings.

        lets say I take data from Kennedy Airport in 1970 and again in 2011 it shows a warming trend. I take data from John Browns farm in 1970 and again in 2011 and it shows the same warming trend. That I can buy and acknowledge as good data.

        If I took data from a station in 1970 when it was in the middle of bean fields then took data form the same or nearby station 40 years later and it was now a urban shopping area and residential neighborhoods and it shows a warming trend how much is natural and how much is from the UHI ? A question totaly unrelated to this thread would be how models take into consideration the sheer amount of roofs that have been built, Air conditioners that have been installed and asphalt that has been poured int he last 40 years.

        I do not doubt the Earth is warming, UHI data shows me that. It is the land and ocean data I have a issue with.

        Apologies to Dr Curry and all the rest of the posters for the slightly off topic questions but this is a fascinating and complex field.

      • @Jim in SC…

        If I took data from a station in 1970 when it was in the middle of bean fields then took data form the same or nearby station 40 years later and it was now a urban shopping area and residential neighborhoods and it shows a warming trend how much is natural and how much is from the UHI ?

        Well, once we have a more general trend, you might subtract it from that. But you have to understand: they’re looking for a global trend. They included your Kennedy Airport station and your urban shopping area stations in the total average, but left them out of the “very-rural” average. Of the stations you mentioned, only John Brown’s farm was included in the “very-rural” average. Then the compared the two averages.

        steven mosher is correct that the farm may have an acre of asphault around the station today when it didn’t 40 years ago, but unless there’s a general pattern of that sort of thing happening, it probably won’t be significant. IMO.

      • Thanks for the reply AK, so why not just eliminate all urban data from the reports,that way any UHI effect would certainly be eliminated.

        In my mind at least though I don’t think I could ever have any confidence in report using surface temperatures. Too many factors involved that allow for error, including the political bias of those who are compiling and “homogenizing” the data. That does not mean that I question the warming, it ‘s just the degree of warming that I have questions on. That and what if anything we can do to change it and for that matter whether it is even a crisis

        Anyway when looking at temperatures we still cannot explain past temperature changes and until we can do that we cannot determine how much of present day warming is due to anthropological influences.

    • Steven Goddard makes the interesting observation that the BEST temperature matches or is below Hansen’s 1988 Scenario C forecasts with NO CO2 emissions after 2000. i.e. Muller supports the case for Global warming skepticism.

  6. I like the Economist magazine but the chart they have only goes to 2006, what’s up with that? One would think in this age that missing 5 years of data is odd. Plus the graphic shows a temp increase since 1800 anyhow. I’ll admit the video time lapse temp graphic of the temp data at dotearth is entertaining even though the colours are silly and misleading – the planet is not a melting hot iron, lol. They don’t show ocean temps on it either.

    If the temp has gone up 1 degree, so what? Most of it looks like it was going up anyhow. We have 7 billion people now but back when it was cooler it was much less population so we need the extra heat and co2 and we will need more. We are lucky temperature is not going down.

    • Its a 10-year moving average, with the median year plotted, so the 2006 datapoint is the mean 2001-2011 temperature.

      • Thanks Zeke, I didn’t notice that, is it a simple moving average or exponential? And do you know why they use 10 years and not 5 or 8 or 20? My first experience with moving averages was in the stock market. The problem with moving averages is that all points are usually weighted equally but the last points are actually the more important as you probably know. Also it adds another factor that the average time could have been cherry picked to suit a trader’s message. For example for the stock, if choose a bigger number you flatten the line out. Traders often used both exponential in combination with simple along with the real numbers because both have criticisms. Also in the stock market people that use technical analysis like that are usually no better off than other types of traders. The trend is your friend (but all trends must end).

      • Kermit

        Good points.

        10 is always a suspect number. It’s unlikely to be the fittest number, if it was just picked for convenience; it’s unlikely a number picked based on the properties of the data would come out to exactly 10; even if it was picked to be fittest, the question is always fittest for what purpose.

        And I don’t recall seeing the rationale discussed anywhere in their documents. If anyone knows, I’d be obliged.

  7. Anthony Watts

    Judith wrote: “I am honored to have been invited to participate in this study, which I think was conducted very well.”

    Hmmm are you sure? Even though I sent a correction a correction to Dr. Richard Muller on October 6th, and got a reply, they still can’t fix the 6 occurrences of getting the name of our paper right. Look right under Figure 1 here:

    http://berkeleyearth.org/Resources/Berkeley_Earth_Station_Quality

    —–Original Message—–
    From: Anthony Watts- ItWorks
    Date: Thursday, October 06, 2011 3:25 PM
    To: Richard A Muller
    Subject: Re: Our paper is attached

    Dear Richard,

    Thank you for the courtesy, correction: Fell et al needs to be corrected to
    Fall et al in several occurrences.

    When we complete GHCN (which we are starting on now) we’ll have a greater
    insight globally.
    Best Regards,
    Anthony Watts

    And Dr. Muller’s reply:

    —–Original Message—–
    From: Richard A Muller
    Date: Friday, October 14, 2011 3:35 PM
    To: Anthony Watts- ItWorks
    Subject: Re: Our paper is attached

    Anthony,

    We sent a copy to only one media person, from The Economist, whom we trust to keep it confidential. I sent a copy to you because I knew you would also keep it confidential.

    I apologize for not having gotten back to you about your comments. I particularly like your suggestion about the title; that is an improvement.

    Rich

    On Oct 14, 2011, at 3:04 PM, Anthony Watts- ItWorks wrote:

    > Dear Richard,
    >
    > I sent a reply with some suggested corrections. But I have not heard back
    > from you.
    >
    > Does the preprints peer review you speak of for this paper include sending
    > copies to media?
    >
    > Best Regards,
    >
    >
    > Anthony Watts

    • Maybe nitpicking here, but Revkin is with the NYT, does that count as a copy to the media? He seemed to have a post ready. Doesn’t really matter but still.

    • Anthony Watts,

      In the first comment to your post where you put the topic of Public Relations before the results of Best Temperature Project, we read this comment from JeffC:

      > I warned you that this would happen when they asked you to assist … I hope you really aren’t suprised to have gotten fleas from these dogs …

      Here is a Voice of God reply:

      > REPLY: I took the BEST team at their word, without ascribing motives. Perhaps they started out with the best of intentions, but got paved along the way. – Anthony

      http://wattsupwiththat.com/2011/10/20/the-berkeley-earth-surface-temperature-project-puts-pr-before-peer-review/#comment-772832

      Your reply does seem to imply that the Best Team went to Hell with the process as you first envisioned it.

      To clarify, here are two questions:

      First, could we presume that you started with the best of intentions, and then legitimately speculate about anything we fancy and make some wink wink, say about your morality, once we said that we won’t ascribe motive to you?

      Second, do you imagine Hell as cold or hot? There are conflicting views regarding this symbol. In some circles, it’s very hot. In others, it’s glacial.

      Many thanks!

  8. Norm Kalmanovitch

    To true climate scientists this is a wonderful new dataset that might provide insite into real climate studies.
    To the believers on AGW orthodoxy it is another black eye because this dataset still shows warming from 1910 to 1942 with an increase in emissions from 3.5Gt/y to 4Gt/y and cooling from 1942 to 1975 when emissions increased from 4gt/y to 20gt/y disproving any possible correlation between CO2 emissions and global warming which is the entire foundation for the case in support of AGW
    honest science 1 global warming fanatics zero

    • Vince whirlwind

      “…warming from 1910 to 1942 with an increase in emissions from … cooling from 1942 to 1975 … disproving any possible correlation between CO2 emissions and global warming…”

      It doesn’t disprove anything of the sort. Do you *really* need this explained to you?

    • Yes, Norm. Just because there is a lack of correlation, doesn’t mean there’s no link to cause. You must BELIEVE!

  9. Hank Zentgraf

    Hi Judith. Strange that such an important paper would be released before peer review. Is that a recognition that review is not important?

    • Nebuchadnezzar

      It’s fairly common for papers to be made public once submitted. It’s less common to have a media hoopla to celebrate the fact.

      From what I’ve read it sounds like the papers have been submitted. I wonder if any reviews have come back yet?

      • Hank Zentgraf

        Yes it is common. Do you think it is good practice?

      • Nebuchadnezzar

        It gives the authors a greater chance to avoid committing a flawed paper to the permanent record, perhaps. It gets more eyes on the analysis at an earlier stage. Some papers get mired in peer review and don’t see the light of day for months, or years. I, for one, am pretty glad the papers are out there now rather than a year from now. I’ll be interested to see what, if any, changes get made if, or when, the papers get published.

    • No, it seems to be a compromise between making the data available as soon as possible, providing documentation, not getting scooped in terms of initial publications.

      • But why would Muller make his dumb statement about convincing skeptics? The work is related to a very small piece of a tiny part of the CAGW pie. Does he have an inflated view of his own importance? Or a very flawed understanding of what the argument is about?

      • Vince whirlwind

        I guess since the “sceptics” were trumpeting the “unreliable temperature record” so loudly, the fact that Muller has proven this to not be the case should give many of them pause for thought, meaning this paper is significant to “sceptics”.
        What remaining justification is there for denying what climate scientists have been telling us?

      • “the fact that Muller has proven this to not be the case should give many of them pause for thought,”

        How has Muller proven that it is not so?

        “What remaining justification is there for denying what climate scientists have been telling us?”

        Climate science is telling us a lot of stuff, most of which has nothing to do with the temperature record, so what are you talking about?

      • “I guess since the “sceptics” were trumpeting the “unreliable temperature record” so loudly, the fact that Muller has proven this to not be the case should give many of them pause for thought, meaning this paper is significant to “sceptics”.”

        No one is disputing that the temperature record was taken and is being taken inaccurately.
        Meaning that the procedure one is suppose follow to take temperatures readings is not widespread and commonly followed. Resulting in getting measurements which can be 5 C in error.

        The merit of such “unreliable temperature record” hasn’t being proven, rather instead, it’s considered adequate to provide accurate average temperature.

        Just because you drive a backfiring car with poor brakes, doesn’t mean it’s unproven to be good car.
        Since this has not been examined as all science has to be examined, there no reason to assume the driver hasn’t wrapped the car around some telephone pole.

      • “What remaining justification is there for denying what climate scientists have been telling us?”

        There is plenty of justification, the temperature record was (and to an extent still is) about data quality and transparency. It was claimed/suspected that data was being manipulated in order to advocate a theory – a perfectly reasonable theory – but one in which the manner of scientific conduct opened itself to a great deal of suspicion, the infamous hockey-stick is but one example.

        Since I have been following the debate, very few skeptics have been concerned by the voracity of the temperature record – in fact they use it to make the case about the doubtfulness of the CAGW proposition. (It’s worth noting that most skeptics also accept much of the AGW idea and science behind it). What most skeptics object to is overstating the attribution of late 20th century warming to GHGs and anthropogenic influences. And they point to the existing temperature record to make the case.

        You responded to Norm earlier in the thread but I suspect you may have missed his point. He was pointing out that the correlation with CO2 emissions and temperature change is poor. It maybe that it has some effect but it is completely swamped by natural variability. The last decade is showing no warming at all despite 30% of all the GHGs we have ever emitted entering the atmosphere.

        That does not mean we won’t ultimately have a problem, but it is safe to assume that the problem is not as large or as urgent as we first feared.

      • It seems to me the ‘voracity of the temperature record’ done et Dr. Muller up.
        =========

      • Vince Whirlwind

        Agnostic says:
        “it was claimed/suspected that data was being manipulated in order to advocate a theory – a perfectly reasonable theory”

        I’m sorry. Nutty conspiracy theories such as the one you describe are not reasonable. At all. Now proven to have been completely wrong, of course.

        “the correlation with CO2 emissions and temperature change is poor”

        Which part of climate science suggests there is such a correlation? How on earth could anybody who has spent even the most cursory amount of time on this issue even make such a statement?

        What is see here is *not* any sceptical analysis of available information. What I see are facts, logic, and history being tortured to fit a pre-conceived notion.

        BEST has put to rest some of that torturing (the silly conspiracy narrative Agnostic describes).

    • Judith
      Is this posting before peer review
      A rush to meet the deadline of IPCC’s AR5 cutoff? Or
      Seeking a widespread public/blogsphere “peer review”?

      • Trying to make the data set available as soon as possible with some documentation

      • Judith

        I’ve read all the way through but can’t see any of the nuances I expected-just a ‘global’ increase. Where is the mention of the 28% or so of stations that Dr Muller said were cooling, how many are static and how many are situated in uhi affected environments? Are there other papers I haven’t seen?
        tonyb

      • Judith

        I found the other papers and read this;

        “We compare the distribution of linear temperature trends for these sites to the distribution for a rural subset of 16,132 sites chosen to be distant from all MODISidentified urban areas. While the trend distributions are broad, with one-third of the stations in the US and worldwide having a negative trend, both distributions show significant warming.”
        AND
        ” A histogram of the station trends is shown in Error! Reference source not found.a, categorized by station record length. The distribution is broad with a width substantially larger than the mean; 67% of the slopes are positive, i.e. there are about twice as many warming stations as cooling stations.”

        There seem to be several places with the message
        ‘Error reference source not found’

        Consequently I’m not sure if the histogram showing the cooling stations is actually present in the paper. Do you know?

        Poor piece of research claiming London is the first example of Urban heating. It was Rome, as various articles attest, with Nero being perfectly aware of the effect and the causes.

        tonyb

      • If roughly one third show cooling and two thirds show warming then, given the huge uncertainties inherent in the averaging, it seems we do not know if it is warming or not. Note too that the UAH readings show no warming in the 1978-97 period when the surface statistical models show the most warming. The surface models are probably falsified by this difference.

      • Steve McIntyre said:

        “I commented on one replication issue – the BEST assertion that, using the Anthony Watts classification, the trends at “good” USHCN stations was higher than the trends at “bad” USHCN stations. I attempted to replicate this aspect of the analysis and got an opposite result.”

        If true, this demolishes BEST and those who helped them.

        http://wattsupwiththat.com/2011/10/21/sceptical-berkeley-scientists-say-human-component-of-global-warming-may-be-somewhat-overstated/#comment-774358

      • It will probably end up demolishing McIntyre. He says that he hasn’t looked at the BEST methodology yet in his comment. So whatever he did, he did it wrong.

      • I’ve got popcorn and look forward to more Mannian-type “innovative” methods being exposed.

      • Rattus Norvegicus. Truly and admirable character. Never let’s preconceptions get in the way of his rock solid objectivity.

      • Nebuchadnezzar

        David,

        As long as the paper is submitted by mid-Nov and made available to the authors of the appropriate chapter then its eligible to go in, far as I know. You don’t need to make it public in any way.

        I’m intrigued by the statement that they wanted to avoid being scooped. Scooped by whom?

      • That caught my eye, too. I wasn’t aware that this was the newspaper business.

      • I expect we should stay tuned…

      • “I’m intrigued by the statement that they wanted to avoid being scooped. Scooped by whom?”

        Maybe they were afraid Anthony Watts would be called to testify before congress and he would make a statement that he had seen the preliminary BEST data and it coincided with his views on UHI, and undermined Muller’s.

        Nah, he’d never do a classless thing like that.

      • The cut off for submissions for AR5 WG1 is July 31, 2012. The cut off date does not seem to be driving this.

  10. My email to BEST:

    I was really looking forward to the BEST project results.

    Then you go and make a dumb-a$$ed move like this.

    Nothing yet peer-reviewed, simple typo mistakes uncorrected after advance notification, and different time series comparisons for the UHI paper.

    Not to mention the full-court PR campaign. Just what are you trying to accomplish here?

    It may be salvagable if you ever get it right – we’ll see – certainly off to a really bad start.

    Way to blow a great opportunity – unless of course, this was the plan all along!

  11. I’ve just taken a quick look at the funding information for the BEST team, which is:

    Funded through Novim, a 501(c)(3) corporation, the Berkeley Earth Surface Temperature study has received a total of $623,087 in financial support.

    Major Donors include:

    – The Lee and Juliet Folger Fund ($20,000)

    – William K. Bowes, Jr. Foundation ($100,000)

    – Fund for Innovative Climate and Energy Research (created by Bill Gates) ($100,000)

    – Charles G. Koch Charitable Foundation ($150,000)

    – The Ann & Gordon Getty Foundation ($50,000)

    We have also received funding from a number of private individuals, totaling $14,500 as of June 2011.

    In addition to donations:

    This work was supported in part by the Director, Office of Science, of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231 ($188,587)

    So now (pending peer-review and publication) we have the interesting situation of a Koch institution, a left-wing boogy-man, funding an unbiased study that confirms the previous temperature estimates, “consistent with global land-surface warming results previously reported, but with reduced
    uncertainty.

    The identities of the people involved with these two organizations can be found on their websites. Let the smirching begin.

    • Not sure where you are going with this one either.

      Bill Gates is rich, but not much of a right winger or oil industry insider. I would tend to think his donation counter acts any Koch money.

      • I’m thinking maybe this is actually what it claims to be: an objective look at the data without reference to any political agendas. People like the Koch’s and others who’ve been pointed at by their enemies have a decent incentive to sign on, both to clear their names and to get in on the ground floor of what might actually replace the IPCC.

        Wouldn’t be any surprise to me if the Open Society Institute also offered a chunk of money, and it was accepted. Presumably without strings, although that’s something that the public needs to keep an eye on. (In both cases.)

        The big question regards the people running it: the executive board and the Science Advisory Board. I’m not as familiar as I should be with the names, but given our host’s apparent approval, and a very brief scanning, I’d guess this is a very good start.

      • Kermit,

        Perhaps you missed the most important operative word-of-the-day: MAYBE.

        I’ll try to underline them as we go along in the thread, for our own edification.

    • The Koch family, in the real world, funds a great deal of science research and journalism.
      In the AGW fever swamp, they are funding satan’s child eating followers.

      • Well, I’d guess the same is true of the Open Society Institute, although I don’t have any proof, and I have to admit moveon.org isn’t a very good example.

  12. Dr. Curry
    Just finished reading the paper:
    Decadal Variations in the Global Atmospheric Land Temperatures
    I am still rewriting my rudimentary reflections on the AMO, so when completed it might be an entertaining short ‘read’ for the co-authors of the above paper.

  13. On warming, my view is that the first two IPCC propositions, (i) that the earth has warmed over the 20th century, and (ii) that this warming is historically unprecedented, cannot be supported strongly by observational data.

    IMO the data vary so much in quality over time that we do not possess valid or reliable data for the 20th century at all. We may have a rough picture of what has happened, but not something that warrants findings expressed to decimal places. To compare observational data for the 20th century with proxies for preceding centuries seems pretty hairy to me but, again, it may give us a rough picture.

    The BEST analysis is of land data, which covers less than half of the planet’s surface. Everything I have read about SST gives me much less confidence that we know anything about temperatures in and over the oceans even now, and hardly at all for the 20th century.

    What happens when you put land and sea data together? You get a dreadful mess of incompatible results, from which someone points out that year X was warmer than year Y, because of a ‘finding’ expressed to three decimal places. What has happened to common sense, to ordinary scepticism?

    It seems to me that people must be almost desperate to be analysing and extrapolating stuff that is so poor in origin. Why do we do it? Because, again IMO, some people are simply wedded to the threat, and we have all been caught up in that mood. It’s so important. Humanity is at stake. Catastrophy looms. Etc.

    • I don’t think any believes catastrophe looms because everyone knows nothing will change. Even if with four more years of Obama. Why? Because the rest of the world intuitively understands that the science authoritarians of Western civilization are a big joke on the US.

    • Don,

      “Everything I have read about SST gives me much less confidence that we know anything about temperatures in and over the oceans even now, and hardly at all for the 20th century.”
      —————————————————————
      From BEST FAQ site:-
      http://berkeleyearth.org/FAQ.php

      “What is next for Berkeley Earth?”

      “As a next step, Berkeley Earth plans to address the total warming of the oceans, with a view to obtaining a more accurate figure for the total amount of global warming observable.”

      Last I heard from JC was that funding was not yet in place for “next”. Maybe that has changed?

      • Green sand

        Following my article on SSTs carried here
        http://judithcurry.com/2011/06/27/unknown-and-uncertain-sea-surface-temperatures/
        I have been out in my rowing boat taking SSts. Can I get some funding please?
        tonyb

      • Tony, many thanks for the reminder, well worth a re-visit.

        Re funding, I might stretch to an outboard:-)

        Interesting that the BEST “plans to address the total warming of the oceans” rather than assess the accuracy/uncertanties in the historic SST data sets, which what I thought was the BEST objective?

        Hay, ho, round and round we go.

      • tonyb, Your article was very clear as to how some of these T’s were collected and raised many questions about the validity of the readings as well as the problems with global coverage over time. Brief, as it has been. Even the blind could read the size of the actual error bars that came with most of the early data that had been collected.
        We don’t have all, and it is not the best…NOW blame the Weatherman
        For me, you did an outstanding job of putting light on our subject here.
        Thank you, Tom

      • Tom

        Thanks for your kind comments. I have had several email exchanges with John Kennedyof the Met office (a fine scientist) who wrote an article about SSts immediately following mine. The uncertainties are to me so great that it is impossible to quantfy the corrections needed to make them useable. The SST variability is also much greater than is claimed and the time window in which anyone could put a thermometer in the bucket and get an accurate picture of the internal temperature is as little as three minutes, depending on ambient temperatures. This information was derived through actual physical observation. In my opinion SSTs prior to 1950 or so should not be used. The jury is out on more modern readings.

        tonyb

      • tonyb, If you would please ask your friend at the Met office, to give you ‘the rest of this story’, from late 2009. Just what were all of the ‘originals’, that were put down on paper… recorded and then ‘dumped’? What did Phil Jones mean exactly, when he wrote those words? Also, what is the percentage of historic weather records of the B.E., that are still extent? If your friend could provide you with a link to the manifest of what was collected from around the world and over what time frame does this useable record cover? This has been an obvious question that has yet to be addressed by MSM. We have come along weigh, from the Dooey Decimal System II.

        “Scientists at the University of East Anglia (UEA) have admitted throwing away much of the raw temperature data on which their predictions of global warming are based.

        It means that other academics are not able to check basic calculations said to show a long-term rise in temperature over the past 150 years.

        The UEA’s Climatic Research Unit (CRU) was forced to reveal the loss following requests for the data under Freedom of Information legislation.

        The data were gathered from weather stations around the world and then adjusted to take account of variables in the way they were collected. The revised figures were kept, but the originals — stored on paper and magnetic tape — were dumped to save space when the CRU moved to a new building.”

        I just have to wonder what price a collector / Universal Investor, would have paid to keep it out of the land fill / energy to waste plant…?

        Whooo No’s

      • Tom,

        according to the Climategate e-mails, Phil Jones sent the data to at least two academics for research. I wonder if anyone has requested copies from them????

    • What has happened to common sense, to ordinary scepticism?

      I am increasingly leaning towards the conclusion that they flew out the window when “post-normal science” walked through the door.

  14. “My hope is that this will win over those people who are properly sceptical,” Richard Muller, a physicist and head of the Berkeley Earth project, told the Guardian.

    “Some people lump the properly sceptical in with the deniers and that makes it easy to dismiss them, because the deniers pay no attention to science. But there have been people out there who have raised legitimate issues,” he said.

    He can’t possibly be that stupid. His work doesn’t even begin to address causation. But I think he makes his agenda pretty clear.

    • I’m also curious. I wonder how he knows whether deniers pay attention to science. Dr. Deming is a scientist who proudly claims the title of denier.

      It’s really amazing how often scientists open their mouths and manage to reduce the public’s respect for science with every word they utter. One is forced to wonder how good the science can be when rational thought seems so difficult.

  15. I’ve always felt that from a strategic POV, the constant fighting about relatively small differences in recent temperature records is not smart. Which is not to say it’s not legitimate.

    Already the MSM is misinterpreting this just as you’d expect: Skeptics Can No Longer Doubt That the World is Warming!!

    As if it were some great AGW triumph. That is of course, not the issue.

    I have this vague feeling that Anthony got himself snookered on this one.

    • “Already the MSM is misinterpreting this just as you’d expect: Skeptics Can No Longer Doubt That the World is Warming!!”

      Actually, they seem to be following the lead of the scientist in charge of the project.

    • denialist crank

      “I’ve always felt that from a strategic POV”

      And that’s what’s important, that our strategies to defeat belief in CAGW be successful. Facts and science is not important, validating our prior held position is.

      • Vince whirlwind

        Absolutely.
        Add to that the fact that land station temperatures were never ever the issue in the first place – it’s *sea* temperatures that are going to prove that CAGW is all a hoax.

  16. “I will remind everyone that the REAL problem with the surface temperature data set lies with the ocean data. I hope that the Berkeley group will be able to extend their efforts to include ocean data.”

    I think that deserves emphasis. If we look at global warming trends, they closely parallel ocean warming, and the land warming data have less impact on mean values. This is not surprising given that the oceans cover about 70% of global surface.

    On the other hand, if the BEST land data are unsurprising, the ocean data will probably not be either to a large extent. Over the long term, there is a relationship between land and ocean temperature change, such that the ocean warms at a rate somewhat lower than the land rate but not dramatically lower. The relationship is determined largely by the greater heat capacity of the ocean and the temperature-moderating effect of evaporative cooling over the ocean. In addition, the ocean itself has a significant impact on land temperature change through advective patterns. Although controversial, some land/ocean temperature model-based studies have suggested that land warming is more a consequence of ocean warming rather than direct radiative forcing over land (this is possible despite the higher land rate because the smaller land heat capacity permits greater warming for the same amount of heat shared by land and oceans).

  17. Keeping the ball rolling…nuts! How long will be before we see ads from class action attorneys on TV: “Are you suffering from meso-globalwarmia caused by big oil?

    Funding five more years of more filing cabinets full of AGW junk science should pretty much do US in.

    Question: Greece is currently suffering from a man-made disaster (the we’re creating here at home). If we want to make a donation to help them out, do we send the money to Greece or Germany?

  18. holds head in hands…again Muller manages to grasp defeat from the jaws of victory…he could have published a definitive set of agreed temperature records….and the idiot thatch-gobbler blew it.

  19. It looks like you science rejectionists are now denying you’d ever questioned the temperature record in the first place. You’d never raised the issue of the “urban heat island effect”. You’d never argued that the recent warming was due to various natural cycles and wasn’t at all unusual.

    And there was I thinking that was exactly what you’d said! I’ll have to take a look at some old postings to refresh my memory, perhaps.

    Never mind. You’ll still be able to say that “correlation doesn’t prove causation”. How about the “global warming is a good thing” argument? There must be a fair bit of mileage left in that one. We all like warmer weather, don’t we?

  20. Tempterrain – nice to see you’ve solved the UHI problem. I’m sure Judith will gladly invite you to join BEST, since you’re so much ahead of them on the topic.

  21. It fascinating to see how Ms. Curry avoids actually saying anything about the result … namely, that there is no significant UHI effect, in agreement with previous scientific studies. And it’s fascinating to see the lengths to which the deniers go to discount this work promoted by and funded by deniers.

  22. tempt. writes: “It looks like you science rejectionists are now denying you’d ever questioned the temperature record in the first place. You’d never raised the issue of the “urban heat island effect”. You’d never argued that the recent warming was due to various natural cycles and wasn’t at all unusual.”

    There’s a lot wrong with the above. Your first few sentences are simply not true. Who is denying those things? And your last sentence would lead one to believe that this project in some ways demonstrates causation. Show me where it does that so I can go ahead and eat my hat (my favorite Key West baseball cap in fact).

  23. BEST seems like it took a fair amount time and effort.
    1/2 million dollars donated and unknown [to me] amount manhours
    spent on project.
    What aspect of project took the most effort?
    Anyone know?

  24. What did they do about polar coverage?

    Why do their charts leave out comparison with the satellites?

    • Buzz Fledderjohn

      Tilo… The data and papers released today are about land based data. The data they are looking at are surface stations. They relate to the land data from the other three land based data sets. Next they are going to produce ocean data to complete the global data set. The satellite data will relate more to the total global data when it comes out.

      The issue with the papers released today have to do with the reliability of the surface station data. All the papers released today are available to download at the BEST website. They are taking public comments on them prior to submission for peer review.

      • Buzz. GISS polar data is also land based from surface stations around the rim of the Arctic. And then it is simply extrapolated across the poles. This causes huge errors.

        As far as I can tell, Berkley also does a form of statistical extrapolation and interpolation that is called Kriging. If they do this across the poles like GISS does, then I see no reason to think that it doesn’t have the same problems as GISS.

      • Buzz Fledderjohn

        Tilo… But that’s not what they’re looking at in these papers. They’re looking at land data. You can pull up the exact same land data for GISS and HadCRU.

        I suggest reading the papers.

      • “The issue with the papers released today have to do with the reliability of the surface station data. All the papers released today are available to download at the BEST website. They are taking public comments on them prior to submission for peer review.”

        Could it be said their greatest contribution is providing an accessible data base?

  25. A summary of the UHI pre-pre-pre-pre-paper:

    1. The UHI exists in named places (eg Tokyo)
    2. Within the same paper, Tokyo’s UHI varies from 2C/century (introduction) to 3C/century (discussion)
    3. By shooting in the dark (classifying in a rough fashion a large number of unnamed places), the UHI doesn’t exist any longer
    4. We don’t have the time and/or the money to verify if the UHI remains disappeared when using named places, individually assessed and perhaps even (shock! horror!) assigned a degree of urbanization
    5. A back of the envelope calculation suggests that if 27% of the Global Historical Climatology Network Monthly (GHCN-M) stations are located in cities with a population greater than 50,000, then assuming a UHI of 3C/century the the contribution BY UHI to the world MEASURED average is 3*27%=0.81C
    6. Nevermind, there’s always space for pure speculation

    • No effect for UHI simply doesn’t pass the smell test. But let’s try a thought experiment. Let’s say that in 1900 you have a thermometer that is surrounded by 5 miles of concrete and asphalt in all directions. By 2000 it has 10 miles of concrete and asphalt in all directions. We’ll call this the Urban thermometer.

      Then, let’s take a thermometer that is sitting in the middle of a cow pasture in 1900 and then in 2000 it is surrounded by concrete and asphalt for 500 yards. We’ll call this the rural thermometer.

      Which of the two thermometers will have increased the most in temperature?

      Seems to me that using the 16,000 least urban out of the 39,000 and then comparing them against the 39,000 doesn’t prove a thing. Better to use 100 thermometers that are known to have no change at all in site conditions than 16,000 that could still be effected by construction. Their method seems to suffer from the old brain dead mechanical approach combined with unverifiable assumptions that all the other sources suffer from.

      And to simply conclude that UHI makes no difference? Come on – get out of my face.

      • Buzz Fledderjohn

        Tilo… You’re missing the whole point. Rather than doing thought experiments and performing smell tests why not just read the paper?

      • Buzz – you’ve missed the whole paper.

      • Buzz:
        I looked through the paper. I don’t see how it answers any of the questions. Comparing the 16000 least urban against the entire 39000 doesn’t answer the questions that I asked above. If you think it does, tell me how.

    • If find it strange that when one drops large quantities of napalm on a city like Tokyo, then the temperature drops.
      I also like the idea that the ‘urban’ heat effect is directly coupled to lights at night. Do not bother actually visiting the site, use a satellite. Sure, you will miss the sewage farm, the rural airport, the warehouse, the quarry and so on.
      Why bother going to all the trouble of monitoring what actually happened in an area, say from grassland, to dust bowl, to soy, to rice, to soy again, to corn to scrub land if you can uses a satellite to measure night time light pollution.
      Pity you didn’t use a satellite to monitor the night time IR emissions and white light sources.
      Nor does there appear to be any attempt to actually look where and why some stations appear to be cooling and other heating. Why not have a look at the top/bottom 15%. I know that it may be novel in this field, but in most other fields of scientific study there is an attempt to know where variance comes from.

  26. UHI part discusses how much warmer urban areas can heat up.
    With UHI one has the aspect is getting higher daytime temperatures and
    one has aspect of increased night time temperature.
    In Preliminary Findings regarding UHI
    http://www.berkeleyearth.org/resources.php
    They mention that Tokyo as compared to global land temperature is about 2 C higher. That doesn’t mean much as regional areas can vary a fair amount.
    UHI seems to me to have greatest increase in night time temperatures, but for daytime increase in temperature the most important heating factors seems to darker colored surfaces and reduction in heat convection.
    With night time temperatures it seems the greatest affect is the increase of heat capacity of man made structures- mostly paving.

    Is UHI considered a “greenhouse affect”?

  27. Okay, so we know that Berkely uses much the same station data as the other sources. And it looks like they use a method of statistical interpolation and extrapolation called kriging. Is there any reason to think that this might have produced a record different from what GISS got with normal extrapolation and interpolation?

    Also, GISS extrapolates from polar shore stations across the ice. Does Berkely then “krig” from polar shore stations across the ice?

    • steven mosher

      Tilo. I show 17272 stations in the inventory.

      Thats twice GISS.

      WRT polar stations, you best understand kridging before you spout off.
      If you look at the time series they will show how every area is handled.

      To show that there is a problem with the pole you have to show that. not merely assert it. at less than 2% of the total surface area you wont find much effect from treating it differently

      You are welcome to download any data and prove that. not assert, prove. with your code and data made available

      • “Thats twice GISS.”

        Uuuuuhhhh. And that’s important why?

        Steven: “WRT polar stations, you best understand kridging before you spout off.”

        Why do I need to understand kriging? It is a mathematical method. How is a mathematical method going to deal with going from water warmed shore stations to ice bound areas away from shore. They still have no thermometers across the ice. And in order for the method to work they would still have to consider transitions from melted shore stations to ice covered arctic. I doubt that they can do that, since the ice line information isn’t even available before the satellite era. But the question remains, are the “kriging” across the arctic. Maybe we should get the answer to that question that I asked before you spout off.

        “To show that there is a problem with the pole you have to show that. not merely assert it.”

        Wrong again Mosher. If they are going to use a statistical form of extrapolation then it is their job to show that it works in every place where they use it – not just assert it.

        “at less than 2% of the total surface area you wont find much effect from treating it differently”

        Wrong again Mosher. Hansen did a HadCrut mask of the GISS data and showed that there was no divergence when the poles were left out. Whereas there was significant divergence when they were included.

        Mosher: “You are welcome to download any data and prove that. not assert, prove. with your code and data made available”

        There you go blathering on again about code and data. Just because you found a new love that you think makes you a magician you now want to impose that on the rest of us. But it is the methods that matter, and they can be described in simple English. And if the methods are inadequate, then the code and data are also going to be inadequate. It’s the old GIGO rule that every programmer knows.

    • Berkeley, AFAIK, is land stations only. They probably treated the Arctic ocean as not land.

      • Does GISS treat the Arctic ocean as “not land”? If so, why do they give us coverage by extrapolation from land?

        I don’t pretend to know the answer to what Berkely is doing. That is why I’m asking. So thanks Nick, but I don’t need the guesses. I can do guessing for myself.

      • steven mosher

        The Kridging is going to use a correlation length and correlation scale. Its in the paper. go read it.

        or watch how the data is calculated.. see something interesting?

        http://berkeleyearth.org/movies.php

      • The question was, “do they do their kriging over the Arctic”? Now, “how is kriging done”? Did you get that?

      • steven mosher

        You obviously dont get kridging Tilo. go read the paper and get the code.
        you already think its extrapolation and interpolation. hopeless for you.

        When are you getting your nobel?

      • Uh, not sure about ‘Kridging’, but ‘Kriging’ seems to be interpolation.
        http://www.amazon.com/Interpolation-Spatial-Data-Springer-Statistics/dp/0387986294

      • Mosher: “you already think its extrapolation and interpolation. hopeless for you.”

        Yeah, that’s what I think. From wiki:

        “The theory behind interpolation and extrapolation by kriging was developed by the French mathematician Georges Matheron based on the Master’s thesis of Daniel Gerhardus Krige, the pioneering plotter of distance-weighted average gold grades at the Witwatersrand reef complex in South Africa.”

        The question is “what do you think it is”.

        Mosher’s definition of kriging. “A magical process for getting the right answer.”

      • “So thanks Nick, but I don’t need the guesses.”
        No need to guess. At the bottom of p 30 of the Averaging paper they say:
        “Our analysis and that produced by
        NOAA explicitly construct an average that only considers temperature values over land..”

        That rules out the Arctic Ocean.

      • Nick: “That rules out the Arctic Ocean.”

        Oh, I forgot about the word “ocean”. So they are going to give us the Arctic Ocean as an SST? Eh, right Nick?

      • No, they have done a land only analysis, and have not mentioned any plan to include SST’s for anywhere.

  28. Well, I’ve read the Urban Heating paper, (Wickham et al. 2011), and it looks like they’ve done a pretty good job. Basically what they did was “global land temperature record reconstruction using the Berkeley Earth Surface Temperature averaging methodology (Rohde et al., 2011).” for the entire dataset, 39028 stations, and a dataset of 16,132 “very-rural” stations that were at least 1/10 of a degree in latitude and longitude away from any urban regions shown on the “MODIS 500m Global Urban Extent classification map (MOD500) of Schneider et al. (2009, 2010).” (see Wickham et al. 2011 for quoted ref’s.)

    They then compared these two reconstructions (see figure 5 on page 11), finding little evidence of significant Urban Heat Island effect, and indeed after about 1950 the rural reconstruction actually trends very slightly upwards compared to the total.

    This is a perfectly valid way of doing it (IMO, but theirs also), and certainly settles any questions about UHI in my mind. (As if that matters, but let’s see what experts say.)

    Ref:

    Wickham, C., Curry, J., Groom, D., Jacobsen, R., Muller, R., Perlmutter, S., Rohde, R., Rosenfeld, A., Wurtele, J. (2011) Influence of Urban Heating on the Global Temperature Land Average Using Rural Sites Identified from MODIS Classifications Submitted

    • Devil is in the details.

      1. Modis500 was calibrated on a training dataset that used cities in excess of 100K.

      2. Modis picks out “built” not urban. A golf course or city park will register as Rural, however their .1 degree slop factor should get that.

      3. .1 degrees is roughly 10km at the equator but less as you go toward the poles. They need to fix that in the final paper and use a constant radius.
      That work is a bitch,

      4. Station location errors average over 2km, last I looked. This BEYOND reporting precision. So they often report the Wrong location to .1 degrees

      5. The urban/rural differential depends upon the actual character of the rural land before it was urbanized. see Imhoff and Oke.

      6. They didnt control for de urbanization. Some rural sites used to be urban, so you need historical population to eliminate that.

      That’s off the top of my head

      • If I’m going to second-guess the experts, I have to use my own intuitions based on their data, methods, intermediates, and conclusions. I’ll admit it isn’t “pound on the table” proven, but when, for instance, MOD500 is replaced with something more detailed, the whole thing can be re-run. If they did it right, it probably wouldn’t take more than a day or two.

        You know more about this than I do, why don’t you go right to the paper and see what (if anything) they’ve done about the issues you see? That’s part of why they made it available now, rather than at publication.

      • steven mosher

        Their station data set only has 17K stations in it, so Im trying to figure that out as we speak. Some of the files they speak about in the readme are absent from the download

        The whole UHI question turns on the categorization question and its not that easy. Its certainly not as easy as using on indicator even with a buffer.

        I read the paper already. that why I can refer to their .1 degree buffer.
        I know thats an potential issue since I tried the same approach and then realized that the .1 degree buffer changes as a function of latitude. Thats why a more accurate approach is to use a distance buffer rather than a “degrees” buffer.

        ask yourself

        1. How far is .1 degree latitude and longitude at the equator?
        2. How far is .1 degree latitude at 45 degrees latitude?

        Ask yourself, where are over 50% of the stations located..
        it aint the equator.

        So basically by using a fixed degree buffer they have a distance buffer that varies with latitude. Small point, but those are the things I would start to look at

      • But it’s only a problem if the buffer is to small close to the pole. Else it just excludes a few stations that might have good data.

      • “If they did it right, it probably wouldn’t take more than a day or two.”

        That doesn’t help. The categorization of rural would probably not change if you use a more detailed source. But “rural” can still allow for a lot of building around the thermometer. You simply can’t resolve the issue through mechanical means. You have to know what happened to the surroundings of every individual thermometer. That said, I find any conclusion that says there is no UHI effect absurd. The problem in part lies in the name. You don’t have to be urban to get a UHI effect. Take a thermometer 50 miles from anything and build a parking lot next to it and it will show a UHI effect. But the thermometer will not be reclassified as urban.

      • Agree Tilo. UHI is a misnomer. A better name would be Anthropogenic Local Warming (ALW) or ALCC. Some “rural” stations might have more warming trend than some “urban” ones if they developed more over the time period. Land-use change is important.

        The first useful thing to do would be to use only the best stations with known stations history and as little change as possible.

      • steven mosher

        Ok, AK that was pretty easy.

        using the 17000 stations in their site_detail.tx file, I did the following

        Using the modis data they used and several other datasets I looked for a rural station according to their rules. Then I pulled up other data to show you what you get

        Step1: take the station locations and record the Modis value at the purported station location.
        Step2. Take the average of all pixels within 5 minutes ( .0833 degree)
        Step3. Take the average of nightlights within 5 minutes
        step 4 Take the average of Impervious surface within 5 minutes
        Step5 get the percentage of land within that 5 minute grid that is
        designated at uban land
        step 6: Look for a “built” modis pixel ( urban) within 10000 meters

        Then I select all stations that have NO “built” modis pixels within 5 minutes.

        Then, I look through all of those to find stations that “look” rural according to Modis ( at 5 minutes) but may be urban. I stress the “maybe” but this is the kind of double checking you have to do when using Modis or other products. Thats because Modis is built using supervised classification trained on a dataset where the “built” pixels came from heavily urban areas

        Found 97 stations that would be classified as rural by Modis ( .08 degree buffer) but that MAY not be rural

        Here is the first one, Lon Lat

        110673 NORILSK 69.333, 88.125

        According to Modis there are no built pixels within 5 minutes .0833 degrees

        But go to google earth and have a look. about 12% of the surface is impervious, 3% of the land is urban according to other measures of urbanity

        Here’s another one

        20.3500,-74.5000

        Modis thinks that this is unbuilt, BUT the impervious surface database says otherwise

        If I get time I’ll post a google earth tour of the stations, but I really would like to understand why the file only has 17K stations in it first

        It would also help if they publish the station list

      • If it has 17K stations, It’s probably the one that’s already passed their filter. These would be the ones they’re treating as “very-rural”.

        So if I understand correctly, you found 97 stations out of 17K stations that were “iffy”. If so, my next step (if I had the resources) would be to replicate their run with and without those 97 stations and see what difference it makes.

      • It just occurred to me, Steven…

        You’re looking for built-up areas encroaching on the station, but isn’t the Urban Heat Island effect dependent on lots of buildings? We’re not talking about the station being next to a sun-warmed building, we’re talking about a bubble of warm air a kilometer or so high, and several times that in diameter. Putting a parking lot on a farm isn’t going to create an UHI.

      • AK: “You’re looking for built-up areas encroaching on the station, but isn’t the Urban Heat Island effect dependent on lots of buildings?”

        No, you are confusing classifications with reality. Certainly it is true that the more built up an area is, the more UHI effect you would expect there. But all we are talking about with UHI is the effect on instruments that results from the addition of man made structures around the instrument. So, indeed, if you have an instrument on a farm and if you put a concrete parking lot next to it, the instrument is going to start yielding higher temperatures. And that is what we care about – not the fact that the name has “urban” in it. On the other hand, if you have a thermometer in the middle of a city and it’s already built up, you won’t see much change if you put up another building or parking lot a mile away. Of course total city build up will effect the temperature over time because the larger the warmed area is the harder for the heat to dissipate. But when you start to build in a rural area, immediately around the instrument, the effect can increase even faster than it can in an already built up urban area. And that rural area won’t change its classification status for a very long time and until the building gets really dense.

        I’m only pulling this out of my backside, but I would guess that out of 39,000 thermometers in their study they would be lucky to have a thousand with no UHI effect. These things are almost never put in national wilderness areas. They are near roads, close to where someone is able to read them and maintain them. And such areas are naturally subject to population growth.

        But really, do you need to know any more than that they came up with a conclusion of “none, or negative, UHI effect” to know that they are doing it wrong. Come on – a little common sense please.

      • There is more to the problem than that AK

        When you classify urban and rural as a binary distinction and say “rural is X” and throw all stations that dont met that standard into a urban bin you may be putting rural into the urban bin. you have to assess the false negative and false positive.

        That is one of the problems with a binary distinction. when you get it wrong its a double whammy

        Suppose there are 1000 stations.

        Your classifier puts 300 into rural and assumes the other 700 are urban
        The first problem is the false positive rate. so 97 out of 17000. Thats good. Next is the false negative rate. how many of those 700 are really URBAN?

        Lets say that without more detail like a station list I’m not convinced they get the categorization done right.

        Thats NOT saying the did it wrong. I’m not seeing evidence that they tried to assess their false negative and false positve rate. So, throw a few urban in the rural bin and some rural in the urban bin and IF uhi is small then you’ll show no difference or a negative difference.

        There is another way to skin this cat. more later

      • Brandon Shollenberger

        Mosher, that makes no sense at all. BEST didn’t assume the non-rural stations were urban. They specifically sought to avoid that problem by not doing any comparisons involving urban only stations. Instead, they compared the stations “known” to be rural to all stations, including those that are “known” to be rural.

        There couldn’t possibly be false negatives with that.

      • Steve, I have always thought that places that have been known to have had changes in the period of interest should be used as a positive control. USAAF/USAF bases that swelled in WWII, then had runway extensions in the 50’s, then were run down, increased in 80’s and then closed post-Berlin War would be a good start.
        On the other hand, I am sure there mus be land grant agricultural universities, like MSU, that have farming research stations that have records of crop changes in different areas would also be useful.
        The lack of positive/negative controls sickens me.
        As for scouting out locations, hell the Boy Scouts of America have 4.5 million youth members, they all want badges.
        You could do a deal with the BSA and get every location scouted, along with precision GPS coordinates and photographs inside a year.

      • Now there’s a good idea.

      • steven mosher

        WMO has instituted a program to have all member nations upgrade the quality of their location data. It is now reported down to the second
        which is what you really need. Issues

        1. many reporting countries just put in 00 for the seconds
        2. Historical records of prior locations
        3. Metadata for prior locations.

        That said, if you have a really TIGHT filter for rural and its rural now
        they you can probably assume it was rural then. I can even check that with historical population figures for the entire planet. Question can you determine the location for the last 50 years.

        For those where we can… more on that

      • Ya know, if you could replicate their work in a decent run-time, you could try it with some rural stations deliberately modified, see how many and how much error you could introduce before it starts to show. That would give you a limit of sorts on how many stations could be bad without affecting the data.

        Course, they could have done/do that as well, it would make for a tighter paper. Or did they and it somehow didn’t register with me?

      • I think you have to have a record of changes in the immediate vicinity of the instrument – regardless of rural or urban classification.

        But since you have been looking at this stuff, maybe you can tell me about time of day data. Given that time of day readings have an effect, why is there a bias introduced by the time of day changes when they are taken all together?

      • steven mosher

        Tilo TOBS in the US is well documented. ROW? who knows.
        But you need to either

        1. do an explicit TOBS adjustment
        2. “break” the record and let the kridger do its magic

      • Mosher. Again, not what I asked. The question is, why should time of day adjustments produce a positive temperature bias when all of the adjustments are taken together. And the last time I saw the chart, the bias was big.

      • Tilo. You dont know the first thing about TOBS if you have to ask that question. go read Karl. or read the report that jerry B did on John Daly’s old site. Or download jerry’s data. Or do your own homework

      • Mosher: “You dont know the first thing about TOBS if you have to ask that question.”

        Well, Mosher, if you know the answer, then why are you blathering like an idiot without giving the answer? I’m not going to follow your “go read” recommendations because they never answer the questions that I’m asking. Your recomendations simply waste my time. Most of the time you don’t even seem to understand the question. You simply look at it as another chance to rant.

      • Brandon Shollenberger

        Tilo Reber, for what it’s worth, a couple days ago I was curious about an issue Mosher claimed had been disproven by Lucia. When I tried to verify this claim, I found nothing of the sort. Instead, all I found is she had addressed a different, far more minor issue which was somewhat related to the issue being discussed. I asked Mosher for clarification, accepting that I could have simply not found whatever he was referring to, but Mosher never responded. The only response I got was from another person, who got the same results as I did.

        Given that (and other, similar experiences), I support your decision not to follow his “go read” recommendations. I know I won’t.

      • Brandon: Mosher loves to hear himself talk. He’s so anxious to take off and show everyone how insightful he is that he misses the question or the subject much of the time.

      • Brandon Shollenberger

        I can’t speak to that Tilo Reber, but I can say, to me at least, he’s a questionable source. There is no doubt he can provide useful information and insight, but I won’t trust what he says unless I’ve verified it. That isn’t horrible, but it does mean I question a lot of what he says simply because I don’t have the interest it would take to check for myself.

        I’ll listen to somebody who tells me to “look it up” if they’ve earned my “trust,” but otherwise, it just rings hollow.

      • Steven Mosher

        Tilo. do your homework.

        Start here

        http://www.john-daly.com/tob/TOBSUM.HTM

        http://journals.ametsoc.org/doi/abs/10.1175/1520-0450%281986%29025%3C0145%3AAMTETT%3E2.0.CO%3B2

        prior to WWII most stations used to measure in the evening, but over time they shifted to the morning ( 7AM) the empirical studies show that moving from 5pm as a TOB to 7AM introduces a cooling bias of -.9C
        Approximately 30% of all stations ( as I recall) had to be adjusted for this change in TOB.

        At some point you will do your own reading

    • Okay, let me repeat what I just said to Omnologos:

      No effect for UHI simply doesn’t pass the smell test. But let’s try a thought experiment. Let’s say that in 1900 you have a thermometer that is surrounded by 5 miles of concrete and asphalt in all directions. By 2000 it has 10 miles of concrete and asphalt in all directions. We’ll call this the Urban thermometer.

      Then, let’s take a thermometer that is sitting in the middle of a cow pasture in 1900 and then in 2000 it is surrounded by concrete and asphalt for 500 yards. We’ll call this the rural thermometer.

      Which of the two thermometers will have increased the most in temperature?

      Seems to me that using the 16,000 least urban out of the 39,000 and then comparing them against the 39,000 doesn’t prove a thing. Better to use 100 thermometers that are known to have no change at all in site conditions than 16,000 that could still be effected by construction. Their method seems to suffer from the old brain dead mechanical approach combined with unverifiable assumptions that all the other sources suffer from.

      And to simply conclude that UHI makes no difference? Come on – get out of my face.

  29. Judith, quick question. It looks like the AMO index increase of 0.55K from 1980 to 2000 roughly is not outside the natural variability as shown for the previous 100 years. Would not this be prima facia evidence that a lot of the land temp increase since 1980 is due to internal variability?
    Thanks

  30. Very interesting. Obviously it looks at the urban heat island effect in some detail, does the study also look at the effects of anthropogenic heat flux outside of built up areas e.g. freeways through largely rural areas etc?

    • Actually, it’s doing the exact opposite of looking “at the urban heat island effect in some detail“, rather it’s just using a very sophisticated global averaging system to compare the average for all the stations with those known to be not urban.

      • How about comparing the URBAN stations to the NOT-URBAN ones? And are you really unable to see how many questions are left open because of the way a station is classified as “urban”?

      • Well, you see, because of reporting problem with too many of the stations, they don’t know the locations of many stations that closely. Urban areas comprise only about half a per cent of the Earth’s land surface. Sure, if there was good data, they could do anything they wanted with it. The challenge here is to extract useful knowledge from really noisy data.

        Point is, when it comes to the Urban Heat Island effect, if they have a known non-urban population to compare with, they can eliminate the effect, or at least put a good rough size to it.

      • OTOH there was no obligation to stick to all that “noisy data”. And given what is known about the well-known places (such as Tokyo) one would have expected a little more humility and questioning of their own methodology, in the discussion. If they could speculate about asphalt, why couldn’t they speculate about the apparent counterintuitiveness of their results?

        Urban areas comprise more than a quarter of the measurement sites. Don’t forget that. As far as uncertainties go, a great deal of the measured warming could still be due to UHI.

      • “it’s just using a very sophisticated global averaging system to compare the average for all the stations with those known to be not urban.”

        The results don’t mean anything because “not urban” doesn’t mean anything. You can have all kinds of construction happen around a thermometer and still have it classified as “not urban”. No UHI effect defies common sense.

      • I expect plenty of people will be looking for the reason. After all, it’s not that there’s none, it’s that it’s negative.

      • steven mosher

        Wrong. Modis is 500 meter data. Not urban by their definition means that there are no built structures within roughly 10,000 meters of the station location.. .1degrees.

        If you want Modis data you have to write the PI.

      • No Mosher, that is not their definition. I thought you read the paper. Their definition is that urban environments are those that are “dominated” by a built environment. Nothing says that you couldn’t have buildings and parking lots right next to the instrument. In fact, later discussion would indicate that any place smaller than 100,000 would be rural. Check page 5 under “Data”. And the 10,000 meters is relative to places that are classified by a map to be urban. It has nothing to do with there being structures present near the instrument. ROFL. Did you actually think that one third of their instruments were in completely unbuilt environments?

      • Tilo. You are confusing two things. here is how BEST used MODIS to classify

        “An alternative, which we adopt here, is to analyze the urban-rural split in a
        different way. Rather than compare urban sites to non-urban, thereby explicitly estimating
        UHI effects, we split sites into very-rural and not very-rural. We defined a site as “veryrural” if the MOD500 map showed no urban regions within one tenth of a degree in latitude
        or longitude of the site”

        Like I said

        :Not urban by their definition means that there are no built structures within roughly 10,000 meters of the station location.. .1degrees.

        Perhaps you thought I was talking about the Modis definition of a built pixel which is 50% of the pixel being “built” and a continous area of 1km.

      • Still wrong Mosher. There is no such thing in the Modis definition or the BEST definition. You are purely pulling that out of your backside. Very rural simply means that it’s 10K from an area classified as urban. But it can be 49.9% built around the thermometer – as long as it’s 10K from an urban location.

  31. Somebody needs to get their feet wet!

    The oceans have the data, always had, always will. But we do not know about the historic, so quite frankly stop guessing about the past and use resources to ensure present day integrity.

    Quite frankly, any statement or claim about whether this planet has warmed, is warming, is not warming, solely on the basis of land based sensors is incomplete and misleading.

  32. I suggested the BEST team just graph just the rural unadjusted data and was told it was done but I can’t find it on the link they gave me.

    I’d be more inclined to trust this data than the adjusted data.

  33. I surmise that the four pre-pre-pre-papers will get torn to pieces in the next few days. The quality of the BEST work will be measurable in the way they will react to that (making the necessary adjustments, ignoring the lot, or circling the wagons).

  34. steven mosher

    Best part of the papers. its all about the uncertainty

    Follands estimate of measurement noise has always bothered a nunch of us..

    Here is BEST:

    We note that the correlation in the limit of zero distance, � 0 = 0.8802, has a natural and
    important physical interpretation. It is an estimate of the correlation that one expects to see
    between two typical weather monitors placed at the same location. By extension, if we assume
    such stations would report the same temperature except that each is subject to random and
    uncorrelated error, then it follows that 1 − � 0 = 12.0% of the non-seasonal variation in the
    typical station record is caused by measurement noise that is unrelated to the variation in the
    underlying temperature field. Since the average root-mean-square non-seasonal variability is
    ~2.0 C, it follows that an estimate of the short-term instrumental noise for the typical month at a
    typical station is ~0.47 C at 95% confidence. This estimate is much larger than the
    approximately 0.06 C typically used for the random monthly measurement error (Folland et al.
    2001).

    • I must admit I didn’t notice that. I suggested a while ago that one places a grip of temperature reading stations a couple of hundred yards apart and actually measure the error.
      Did they actually do a control experiment?

    • Nullius in Verba

      I noticed the 12% thing, but I thought it was a bit odd how they explained it. They appear to be looking at the correlation r and ascribing proportions of it to different sources – but one normally does that with r^2, and ascribes contributions to the variance. That would mean 22% of the differences is due to independent measurement errors. However, since there are two errors involved – one for each station being compared – the independent error in each station is presumably half that, and then you have to take the square root to get an SD. I’m not sure if they simply skipped over some intermediate steps or if they meant something else.

      But besides the number itself, I found the chart it came from (fig 2 in the averaging paper) to be fascinating. Even at near zero range, there are correlations ranging from 1 right down to zero – 0.88 is just the average. The scatter then drops and widens down to 3000 km, and then it rises and narrows. What is the cause of this behaviour? Why the dip? What is causing so many stations to still be correlated (and anti-correlated) at extreme distances? What sort of spread ought to be expected?

      The following charts add to the mystery. Figure 3 shows that equatorial stations show an even lower zero-range correlation, but a much higher positive long-range correlation. What causes that? They say that it is that tropical weather is less variable, so other influences are proportionately bigger, but it seems to me there’s a lot left unexplained here. If you interpolate between those stations using the mean correlation for the whole dataset, or if you interpolate between stations with poor local correlation generally, you would base your interpolation on assumptions of far more consistency than is the case, which I’d expect to underestimate error.

      I can’t say what the consequences would be, and they might not be significant, but it seems like an area worth looking at in more detail. As this is work in progress, I don’t see that as fatal – presumably they plan to look at it in more detail. But I think the confidence they express in their conclusions is overblown when they have this and many other features, assumptions, and approximations down in the detail yet to explain/resolve. It’s a set of tentative early observations from work in progress, not settled science.

      • But besides the number itself, I found the chart it came from (fig 2 in the averaging paper) to be fascinating.

        Figure 2 is of course a radial correlation function so that there are many more data points that are spatially separated at a distance than at close range. You can see that in that the sparse density of points near the origin. I am not sure how they are incorporating the radial density factor, but certainly the counting statistics are poorer near the origin.

        Correlation functions of energy-conserved systems can show all sorts of wiggles. If some region is too hot, another spot will likely compensate by turning cooler. These are the long-range correlations that scientists are always on the look-out for.

        The main reason for doing this correlation is to provide a good model for the kriging algorithm used elsewhere. The empirical correlation function is the piece that provides the interpolation for the missing points in the grid.

        Scientists and engineers have been doing this kind of spatial regression under different names for years. I just picked up a book yesterday by Mumford called Pattern Theory and once again see how image reconstruction algorithms borrow a lot of these optimal prediction ideas.

      • Nullius in Verba

        “Figure 2 is of course a radial correlation function so that there are many more data points that are spatially separated at a distance than at close range.”

        They haven’t sampled it uniformly on range? Oh dear!
        The left hand end of the chart is the bit we’re most interested in. Why would they undersample it?

        So that would mean the spread at short range is even broader than the visual appearance would indicate, and the narrowing of the spread at the other end is even more pronounced. Rather than any long range correlations, I would suspect in this case that it is because the radial correlation changes with latitude (and probably other factors). There isn’t any single correlation function, there’s a mixture; and there’s more diversity at short range than long.

      • They haven’t sampled it uniformly on range? Oh dear!
        The left hand end of the chart is the bit we’re most interested in. Why would they undersample it?

        Nothing they can do about that because it is just a geometrical effect. Do one of those Google shopping exercises and ask how many restaurants are within a certain radius of your location, and then start shrinking it and the number of course drops. That is basically the idea and it is not a matter of undersampling as it is of oversampling all the distant ones.

        As far as the damping of the waveform with distance, there is indeed disorder associated with this. One of the classic models of uniform disorder on signals is what is called the Sine Integral and it gives an idea of how fast you can lose coherence with a mix of frequencies. On of the benefits of hands-on doing statistical signal processing is that you can look at these kinds of plots as illustrated by Figure 2 and immediately tell what is going on.

      • Nullius in Verba

        “Nothing they can do about that because it is just a geometrical effect.”

        Of course they can do something about that! There’s a limited supply of point-pairs for the very shortest distances, but over most of the range you can set the sample density to suit. They just picked a method for choosing points that weights wider separations more heavily.

        Not sure what you mean by uniform disorder on signals. I’m guessing you mean that if you have a uniformly distributed power spectrum of spatial frequencies over some fixed width, then you get a Sinc-shaped autocorrelation, or something related. Sure, but why would spatial frequencies be sharply limited that way? And given that the next figure shows that we do have a mixture of different correlation functions at different latitudes at least, why that explanation in particular?

        Yes, the shape is reminiscent of a damped wave, and there may be something to that, but it would take more than just a similar shape to justify it to me. Why is it happening?

        Thanks, but I’m having difficulty understanding.

      • Yes, the shape is reminiscent of a damped wave, and there may be something to that, but it would take more than just a similar shape to justify it to me. Why is it happening?

        Thanks, but I’m having difficulty understanding.

        Because of the disorder, this is run of the mill stuff. I will give you a simple derivation.

    • I’m glad you noticed that.

  35. Thank God effects from UHI have been halted — that is what was leaving polar bears adrift on small chunks of ice to starve and die.

  36. He’s even dumber than I thought. http://online.wsj.com/article/SB10001424052970204422404576594872796327348.html

    The Case Against Global-Warming Skepticism
    There were good reasons for doubt, until now..

    • How much of the warming is due to humans and what will be the likely effects? We made no independent assessment of that.

      So he’s just talking about past warming.

      That won’t stop plenty of people from using it to browbeat skeptics about the whole AGW schtick. And did you notice how that disclaimer was just at the bottom of the story? It’s probably syndicated, and anybody needing to remove a couple of column-inches will leave it out.

      Deliberate?

    • The the only thing I would argue with in that op-ed is the characterization of the surfacestations project as careful.

      The dividing line between CRN3 and CRN4 is the 10 meter distance to heat sources. They didn’t go out there with measuring tape for the most part and just eyeballed the station. Given that many of the surveyors probably had a motivation to put the worst spin possible on station siting. How good are you at determining the difference between 32 feet and 33 feet? This is the difference between CRN3 and CRN4.(10 meters is 32′ 9.7″). I race 30′ sailboats, where the 2 boat length rule comes into effect ofen and I always had problems getting that eyeball guess right, even though I had a good sense of what 30′ looks like. My guess is than many of the CRN4 stations are actually CRN3 stations and this would account for the vast bulge of CRN4 stations in the dataset.

      I don’t think that in the end the misclassification of stations would make much difference in the conclusions, I am just arguing with the characterization of the surfacestations survey as careful.

    • It is disconcerting to read that someone width such vast resources of knowledge and thoughtfulness about the problem could say something this fundamentally stupid.

      Apparently he seems to think that climate skepticism could only be based on doubt about the temperature record, and now that he’s settled his doubts about the temperature record he thinks the case against all climate skepticism is settled. There is a name for that category of error.
      ===========================

      • randomengineer

        Apparently he seems to think that climate skepticism could only be based on doubt about the temperature record [snip]

        Actually rather than settling anything at all this begs the question of how anyone seems to think we can determine the global temp (whatever that really is) to within a fraction of a degree when the resolution of the instrumentation is +/- a whole degree (or more!) This of course is exacerbated by worse resolution in past records.

        Moreover, that the world has warmed since the little ice age isn’t being questioned anyway. We have plenty of historic documentation regarding the freezing of dutch canals, the hudson, thames, etc during the little ice age, so observing that this no longer happens isn’t fungible with “buying in” to CO2 alarmism and/or other anthropogenic attribution.

        So certainly a great deal of skepticism *IS* based on the temperature records, and rightly so.

        As near as I can determine the world has been warming naturally for the past 175 years and climate science has yet to quantify what the human contribution is. It seems to me that land use etc contributes the majority of record skew and CO2 is but a minor component. This due to known physics may change if the present understanding of things is correct, but I think from a systems standpoint it seems unlikley that our understanding of the “radiative balance” vis a vis the effects of convection is well understood at all.

        In sum BEST contributes very little here. I’d like to see Dr Curry’s contribution to their knowledge base.

  37. Bob Ward wastes no occasion to say something stupid: “So-called ‘sceptics’ should now drop their thoroughly discredited claims that the increase in global average temperature could be attributed to the impact of growing cities”.

    Will the BEST team ask for a retraction?

  38. Same comment I just left over at Lucia’s:

    Based solely on a quick glance, (all I have time for), the paper “Decadal Variations in the Global Atmospheric Land Temperatures” appears to be a statistical analysis, and fails to consider the processes. It also seems to fail to acknowledge that:
    1. the PDO does not represent the detrended SST anomalies of the North Pacific north of 20N,
    2. the AMO does represent the detrended SST anomalies of the North Atlantic,
    3. and that ENSO is represented by NINO3.4 SST anomalies (not detrended)
    4. that their analyses are comparing apples to oranges to pineapples.

  39. “The group has taken a “team” approach to authorship on this set of papers.”
    Judith, I was encouraged when I learnt that David Brillinger was on the Team, as I expected some interesting statistical advances. And indeed the main statistical paper, BET Averaging, is advanced and interesting, but he’s not listed as an author, though warmly acknowledged. What happened there?

    • Didn’t Charlotte Wickham handle the stats?

    • Nick,

      I asked Judith in another thread:

      judithcurry.com/2011/10/22/changing-minds/#comment-125855

      Here is her answer:

      > I don’t know anything about this[.]

      • I met both Charlotte Wickham and David Brillinger while I was there visiting in March. Charlotte showed me work in progress, Brillinger did not. I think then that “thingsbreak” is correct.

        Charlotte is a grad student. Nice lady, listened to what I had to say carefully. Brillinger mostly talked about himself and his work.

        I think Brillinger, like Saul Perlmutter http://berkeleyearth.org/saulperlmutter.php was added for “star power”. I didn’t see any evidence of output from either. That’s not to say they did nothing, but I got the impression that the core workers were Liz Muller, Robert Rhode, Charlotte Wickham and Don Groom. http://berkeleyearth.org/dongroom.php

        Groom was brought in because he was good at handling large datasets like is found when looking at scads of accelerator particle data.

    • Lord Beaverbrook

      From: Richard Muller
      To: James Astill
      Cc: Elizabeth Muller
      Sent: 17 October 2011, 23:33
      Subject: Re: BEST papers
      …………..
      ‘Keenan states that he had not yet read our long paper on statistical methods. I think if he reads this he is more likely to appreciate the sophistication and care that we took in the analysis. David Brillinger, our chief advisor on statistics, warned us that by avoiding the jargon of statistics, we would mislead statisticians to think we had a naive approach. But we decided to write in a more casual style, specifically to be able to reach the wider world of geophysicists and climate scientists who don’t understand the jargon. Again, if Keenan reads the methods paper, he will have a deeper appreciation of what we have done.’
      http://www.bishop-hill.net/blog/2011/10/21/keenans-response-to-the-best-paper.html

  40. Brandon Shollenberger

    I’m confused. I’ve seen a number of people make comments similar to Judith Curry’s:

    In summary, there are no particularly surprising results here.

    However, the UHI paper says:

    The value for the difference, -0.10 ± 0.06 oC/100yr, is in the opposite direction expected from urban heating.

    We observe the opposite of an urban heating effect over the period 1950 to 2010, with a slope of -0.19 ± 0.19 °C/100yr.

    How is this not surprising? BEST says their conclusions not only show UHI isn’t introducing a warming bias in the record, but instead, urban sites are introducing a cooling bias. They have no explanation as to why this would be, and it contradicts everything we know about UHI.

    Surely I’m not the only one who was surprised to hear UHI isn’t a problem because the cooling bias it introduces is small (not that 10% seems small to me).

    • We’ll have to wait for the final paper release. THis is certainly one i’ll be looking at and having a go at crunching myself.

      It’s a very suprising result to me, not to say it couldn’t be correct, i just can’t see how at present.

      • I believe that their result is correct in a technical sense. It’s just that what they were checking had no correlation to checking for the effect of build on thermometers.

    • randomengineer

      They have no explanation as to why this would be, and it contradicts everything we know about UHI.

      Ummm… no.

      UHI may make an area warmer but once it hits a threshold level increase of population etc doesn’t change much annually. Dr Roy Spencer posted something at WUWT to this effect by saying that it appeared the major change in temp increase took place going from uninhabited land to a farming community level and then the rate of change slowed down (think of an exponential curve here.)

      As such what Spencer says and what BEST claims is consistent and I reckon this to be accurate.

      • Brandon Shollenberger

        randomengineer, your response makes no sense. You say there is a threshold level for UHI, which is obviously true (though what that level is may be debatable). However, there is no logical connection between that point and what I said. That UHI in an area will eventually plateau could in no way cause the UHI effect to be negative. It could cause UHI to be smaller over time if those plateaus were not offset by newer areas of urbanization, but that can only reduce it toward zero. It cannot make it negative.

        You have just argued the warming effect from UHI becomes smaller over time, therefore the warming effect becomes negative…

    • Does this mean that the UHI effect is actually negative or just that it is less positive than it was?

  41. First impressions.

    The papers themselves, hardly important or unpredictable, but pending peer review and audit, seem final enough a slamming of the lid on UHI and of the various other commonplace attempts to impeach the terrestrial surface temperature record’s fitness for at least some climatology.

    Jawdropping the thoroughness of the work and especially the improvement in the dataset by methodology, for the purpose of converting what had been mere meteorological data into climatology evidence.

    And moving the record itself back 50 years (albeit with ridiculously large uncertainty).. useful for impeaching all the LIA garbage so many spout so willfully, and putting into perspective the uncertainty associated with the paleo derivations.

    0.911C +/- etc. at 95% and so forth, back over 50 years? That’s.. just unbelievably improved.

    How improved? Well, for a quarter century, I’ve been holding fast to the position that +/-AGW was probably unprovable on the surface temperature record within our lifetimes, that it was only the best candidate by something like a 10:1 ratio.

    Now, it’s pretty much a done deal, barring something on the scale of a major meteor striking the Earth, and I have to change my stance. Unreservedly, AGW is certain, based on BEST.

    That’s what’s come out of BEST.

    One last impression. Sad commentary that an obvious and sloppy hatchet-job based on blog posts and one-sided research like the IPCC piece of the prior thread is going to make its author money through sales, while such a worthy effort of science as BEST is underfunded to achieve even a fraction of what it might do for policy and science.

    • while such a worthy effort of science as BEST is underfunded to achieve even a fraction of what it might do for policy and science.

      Did you read the acknowledgements to see who funded the reearch?

      • Rick

        Yeah.

        And I didn’t see nearly enough names in the list, other than Koch, of free riders who benefit disproportionately from the subsidized and unpriced use of the scarce carbon cycle resource.

        If they’re going to get so much for free, they ought at least have the decency to better fund scientific inquiry into the harms they do.

      • randomengineer

        If they’re going to get so much for free, they ought at least have the decency to better fund scientific inquiry into the harms they do.

        WTF? Harms?

        If anyone else said this I’d expect it as tongue in cheek but I suspect that you actually believe this rubbish.

      • randomengineer

        So we’ll put you down on the list of people who believe there has been no harm from any fossil fuel industry ever, then?

      • “So we’ll put you down on the list of people who believe there has been no harm from any fossil fuel industry ever, then?”

        I can think nothing more “good” than extracting oil from the ground.
        There are numerous consequences which aren’t good. To focus only what isn’t good is foolish.
        If free people are given the choice: mine oil or not mine oil, the overwhelming majority choice will be to mine oil.
        To think what the overwhelming majority would want as being “bad” is
        fundamentally immoral. And simply very silly elitism.

      • gbaikie

        “I can think nothing more “good” than extracting oil from the ground.”

        Oil pumps produce the ultimate good.

        I’m sure the theologists will be grateful they can stop arguing about that question now that it’s been settled. ;)

        You’re missing the part about ‘free riders’.

        That is to say, those who extract excess benefit without due compensation to those who ought benefit because of the cost imposed on them.

        The carbon cycle is a scarce resource, a system that can refresh the carbon balance at a rate far lower than we impose on it through fossil combustion.

        Who pays for is deficit?

        The future, in unacknowledged carbon cycle debt.

        Why do we leave this burden to the future?

        Because free riders have persuaded us by touting ‘cheap energy’ arguments (that have no actual benefit to the economy, but only distort prices and reduce the democracy of the Market) to government to let them get away with it.

        It’s past time to put an end to that.

        Oh. You thought I meant oil spills and dead sea birds? What sort of nut do you think I am?

      • If free people are given the choice: mine oil or not mine oil, the overwhelming majority choice will be to mine oil.

        The correct term is not “mine oil” but “drill oil” as mines are not typically needed to extract oil.
        But then again you have a point for the future, as the only way we will get any future gains is to lay waste to the landscape and actually mine for all this low-grade-oil-containing “substance”. This would be funny were it not so depressing.

      • Webby,

        the correct term is to drill oil? Is that what they do for Canadian oil sands, a rather significant supply??

        http://www.thefreedictionary.com/mine

        It may not be the most common term, but, it is perfectly acceptable.

      • Webby,

        the correct term is to drill oil? Is that what they do for Canadian oil sands, a rather significant supply??

        Hey Kumkwat, Lower grades of oil are of course mined and that’s why I say it will “lay waste to the landscape”. Look up EROEI and “tar sands” if you don’t understand the concept of “grade”.

      • Webby,

        lay waste to the landscape?

        Into propaganda much??

        You might try something other than VideoGames for science some day.

      • Webby,

        lay waste to the landscape?

        Into propaganda much??

        You might try something other than VideoGames for science some day.

        Kumquat,
        You haven’t seen the aerial photographs I assume. The Canadian government has regulations in place that the excavators have to replant all the vegetation and recreate the landscape and drainage once they are done scraping the earth, but not clear how comprehensive that will be in practice. Only time will tell. It turns out that the remediation takes a lot of energy and that is subtracting from the already meager EROEI from the tar sands itself.

      • Webby,

        your problem is your assumption that everyone is as ignorant as you.

        Yes I have seen the pictures of the mining areas. It would be irresponsible to talk about the issue without a minimum of familiarity.

        Have YOU seen the pictures of restored areas???

        http://www.capp.ca/environmentCommunity/land/Pages/RestoringLand.aspx#wdVL13PgVg4P

      • Have YOU seen the pictures of restored areas???

        http://www.capp.ca/environmentCommunity/land/Pages/RestoringLand.aspx#wdVL13PgVg4P

        Hey Kumkwat, It figures that you would link to an industry-sponsored web page. Your fundamental problem is that you have this naive belief that everyone around you was born yesterday.

      • Webby,

        yup I am naieve.

        Should be easy for you to show they are LYING then!!

        The naievete is electing alledged environmentalist Politicians who promise they will oversee these activities when all they do is extort money from the companies and then let them go.

      • Every volume is removed from the ground, transported, processed, returned to the location, and then the floral landscape is restored after the soil is returned in place (being so north the thickness isn’t that great and a lot may be peat). Thicknesses are between 30 and 100 feet, so it’s reminiscent of open pit mining . The USA doesn’t restore the West Virginia mountain-tops after the coal is removed (obviously, since all the energy used for this would result in a net negative energy capture), so we will see how the Canadians do.

    • Brandon Shollenberger

      How do you conclude it seems a “final enough a slamming of the lid on UHI”? BEST’s conclusions about the UHI (or at least urban/rural site differences) are in direct contradiction to practically everything which has come before it. If anything, it should open a whole new can of worms.

      Also, how do you conclude AGW is certain based on BEST when BEST is just a temperature record? You can say it proves warming, but not the source of that warming.

      Finally, if you’re going to talk about how great BEST’s uncertainty calculations are, you shouldn’t limit your comment to it’s spatial and statistical uncertainties. Acting as though there are no other uncertainties involved is grossly misleading.

      • Brandon Shollenberger

        Good questions!

        How do I repeat the conclusion BEST draws about the UHI, in plainer language? Well, not plainer, really. Perhaps I ought have disambiguated, by clarifying that I meant only the argument at WUWT that UHI could contribute significantly to the shift in global surface temperature was finally put to rest and buried. UHI itself is real and worth studying. At a couple orders of magnitude too small to affect AGW.

        BEST’s conclusions on UHI are hardly new.

        The minorly intriguing puzzle that some cities are heat islands some of the time, sometimes even significantly for the local region, and still might lead to cooler than otherwise wider area temperatures downwind some of the time (due likely particulates mostly) has been commented and speculated on before.

        If you’ve missed the entire body of literature studying the field of urban cooling (here’s just one reference, http://www.hindawi.com/journals/amet/2010/681587/) and this is so novel to you as that you find it contradictory of all your one-sided sources, how is BEST to be held to account for that?

        How do I conclude AGW is certain based on BEST?

        The thing that most substantially held back the certainty of the AGW argument was the poverty of the datasets it was using as evidence. They were a juryrig of meteorological records slapped together with improvised methods that gained most of their credibility from the convergences that three somewhat separate groups obtained from largely overlapping raw data, and the somewhat consistent results over time.

        Now, pending audit and review, AGW has a purpose-built dataset fit for use in climatology for the major AGW hypotheses, to sufficient precision and with sufficient accuracy. I cannot say it proves any of the hypotheses, but I can say it makes a much better foundation for the AGW hypothesis, when combined with other data, than the prior datasets, enough to half and half again the observational uncertainties.

        Finally, while I’m a huge supporter of Chaos arguments and acknowledge this leads to important spatiotemporal questions, there are good methods for determining the scale and scope on which such considerations dominate.

        AGW is chiefly a global multidecadal-to-millennial phenomenon — the observed magnitude of sources of uncertainty in climate over the globe on that timescale due Chaos is smaller than the margin of error in BEST.

        Occam’s Razor tells us not to include more assumptions in our considerations than are necessary. If you’re assuming unknown unknowns, then you’re just being irrational.

        I hope you find in my explanations sufficient justification for the shift in opinion I have expressed. If not, by all means, I remain open to convincing presentations of fact and method.

      • Brandon Shollenberger

        Bart R, thank you for responding, but I’m afraid what you’ve said is extremely difficult to understand. You claim BEST’s results are not new, then go on to say:

        The minorly intriguing puzzle that some cities are heat islands some of the time, sometimes even significantly for the local region, and still might lead to cooler than otherwise wider area temperatures downwind some of the time (due likely particulates mostly) has been commented and speculated on before.

        If you’ve missed the entire body of literature studying the field of urban cooling (here’s just one reference, http://www.hindawi.com/journals/amet/2010/681587/) and this is so novel to you as that you find it contradictory of all your one-sided sources, how is BEST to be held to account for that?

        First, BEST didn’t cite any sources discussing “urban cooling,” so it seems cheeky to act as though I am just ignorant. This is especially true when the paper you linked to doesn’t even support your claim. That paper says:

        Nevertheless, the magnitude of aerosol-induced surface cooling is only 0.5–2°C, and thus cannot fully offset the urban heat island effect, which is about 2–10°C warmer than surrounding regions in summer.

        The only example from the “entire body of literature” you claim I “missed” explicitly states the urban cooling effect cannot even offset, much less overwhelm, the urban heating effect. The only source you provide to dispute and criticize my points is a source which directly contradicts you. This contradiction isn’t subtle or hard to find. It’s clearly stated at the very beginning of the paper’s conclusions. I cannot imagine how you could possibly read your own source and not see it.

        I can accept what you’ve said about why you changed your opinion on AGW, but I cannot think of any justification for what you’ve said about urban cooling.

      • Brandon Shollenberger

        Thank you for your thoughtful correspondence.

        It appears my tone came across poorly, and that it’s sometimes difficult for me to communicate even simple ideas without complicating them needlessly, for which I apologize.

        I don’t claim to know certainly if urban cooling counters entirely or overwhelms UHI. The cite I provided was meant to produce a toe-hold into the literature, not a weighty argument. And yes, the UHI cooling shadow, though probably greater in area by some multiple than the direct UHI zones, does not typically overwhelm the geographic spike of urban heating upwind of that shadow, as you point out.

        There is a large body of research looking into that subject, which Google is infinitely wiser about than am I; it appears to come down largely on the net cooling side, from what I can gather out of the democracy of the internet and the little reading on these matters that I have from time to time done.

        You may wish to scan for original source material from reliable publications within this corpus and inform your own views.

        That BEST restricted its efforts to its own clearly stated goals, and its references to only the references necessary to the goals it stated, ought not be surprising and ought not lift from either you nor I the obligation to inform ourselves independently on the topic.

        That was the whole of my intention in providing that cite.

        However, what is abundantly clear from BEST about the 2% of land surface area that experiences this UHI, and the somewhat larger areas included in the cooling shadows, is that 98% remains forty nine times larger, and that 98% is dominated by a heating trend that is larger than the UHI can account for alone.

        A back-of-the-envelope maybe 2x-to-5x the size of GHG temperature difference, divided by 49 for the area, and compared to the 0.911 figure of the past half-century, amounts to little more than the size of the error bar contributed by UHI.

        Cities might be pilot lights of AGW, but it is amply clear they cannot be the furnace, not by a longshot, given the scale and scope involved.

      • Brandon Shollenberger

        Bart R, I don’t think there was a problem with your tone. The problem is I’m somewhat well acquainted with the literature regarding UHI, and I’ve seen nothing of what you describe. For example, while I hadn’t seen the source you provided (I imagine due to it being newer) I had read the Jin 2005 paper cited in it. The results of both papers indicate there is an urban cooling effect, and both agree it is small in comparison to the urban heating effect. As such, the source you provided changes nothing about the situation as I understand it, and it certainly doesn’t indicate urban stations might have a cooler trend than rural stations due to their urban nature.

        I’ll freely admit I don’t follow the studies of UHI as closely as I could, and I appreciate the source you provided, but as far as I have seen, there is nothing to support your point. To my knowledge, there is no work which indicates urban stations should be expected to have cooler trends than rural stations. I’d be happy to read more if I’m wrong, but I’d need help finding what I’ve missed.

        With that said, I don’t think you and I disagree that much about UHI. As I’ve said before, my expectation has been the effect of UHI is 10-20% of the total magnitude of the trend. To me, the reason UHI is important isn’t that it would invalidate AGW. Instead, I’ve always seen it as mattering for how it affects our views on sensitivities, especially since it would be expected to have an uneven temporal distribution.

        In any event, BEST acknowledges it has no real idea as to why the trend came out the opposite of what was expected. This is a trend which is 10% of the magnitude of the warming being observed. If the trend had been the same size, but in the expected direction, that would make for a 20% difference in results. To me, simply shrugging one’s shoulders in the face of such is highly peculiar.

        I thought BEST was seeking to make a temperature record which was as accurate as possible. Their interest in UHI doesn’t seem to indicate such. They apparently made no effort to understand their results, choosing instead to simply dismiss the error as “very small.” They didn’t even discuss how it impacts the total uncertainty of their results, and it isn’t included in the uncertainty in their graphs. Their results may offer support to the idea UHI isn’t inordinately large (50%+), but they certainly don’t resolve my concerns about UHI.

      • Brandon Shollenberger

        Yes, we somewhat agree, thank you for your clarifications.

        BEST slightly amplifies some of the puzzles of the previous literature, with data that clarifies aspects of evidence for cooling.

        Overall, I doubt anyone expected BEST to settle more questions than it in turn raises.

        Now, we have a dataset more fit to build questions from.

      • “Now, pending audit and review, AGW has a purpose-built dataset fit for use in climatology for the major AGW hypotheses, to sufficient precision and with sufficient accuracy.”

        LOL. There is no new data set. It’s the same old stuff that has been around forever manipulated in new ways.

        “by clarifying that I meant only the argument at WUWT that UHI could contribute significantly to the shift in global surface temperature was finally put to rest and buried. ”

        That may have been the case if the BEST UHI test actually checked for UHI. Unfortunately, it did no such thing.

      • Tilo Reber

        I take a somewhat different view.

        UHI is, while a valid topic of its own in climatology, a completely spent and irrelevant consideration in the big AGW picture, and especially no more can be claimed to disprove AGW by GHE or even to significantly reduce impact.

        There may well be no (or little) new data per se though there is a substantial increase in the amount of data considered in constructing the dataset.

        All datasets are subject to manipulations, or if no explicit manipulations are done, that in itself represents a type of manipulation.

        The fitness of a dataset for various uses depends largely on the type of manipulation.

        The meteorological datasets that have been slapped together for use in climatology are about as suitable as using milkshakes for motor oil.

        True, they contain many of the same elements, but it just doesn’t work very well.

        BEST hasn’t resolved all the problems of data for climatology from the 1800-present day timespan. Nothing can.

        The opportunity to very meaningfully collect such information is truly gone.

        The improvisation BEST came up with, however, allows some analysis that has some validity and value, and helps point the way to the type of information we ought be collecting, and yet still fail to.

  42. Bart R: if you’re familiar with the previous thread you should know one has to.read and understand the actual text before commenting on it. There’s something jawdropping about the uhi paper for.example, but it’s not thoroughness.

    • omnologos (I still love the irony of the name. It was intentional, right?)

      I’m familiar with the previous thread, and so I know how much one has to read of that text before understanding its agenda, method and most glaring weaknesses.

      It’s a slam of the IPCC by stringing together a bunch of nasty things people have said.

      So what? Where is there any value in that?

      The number of nasty things I’ve said myself about just about everything would fill whole volumes on any one topic.

      It doesn’t mean I’d encourage anyone to read the accumulated trash and jetsam of my own intemperate and one-sided slantedly hostile screeds, much less if intermixed with the bad-mouthing one could collect just by waiting for a blog to fill up with flames and trolling.

      And here’s where BEST and the delinquent thing justify some comparative literature. In the case of BEST, skeptical but earnest investigators applied the best thinking they could to all the data they could collect, with remarkable transparency and intellectual honesty.. and surprised themselves by coming to conclusions that they had not expected, fairly representing both sides of argument, and including a fair selection of analyses and criticism from acknowledged experts coming from diverse positions. In the other case.. it’s a litany of faults chained together to come to the foregone conclusion, lacking representative evidence from the many actual stakeholders who the IPCC serves.

      So, no, I don’t need to read a Harlequin Romance to know the type of fiction I’m missing, and I don’t need more than the ample evidence presented by the bookseller and commentators and what I’ve previously seen of the author’s work to dismiss her diatribe.

      If there were a balanced discussion with details of who has used the IPCC’s work, and for what, insider information of the inner workings of their (ie the IPCC’s clients’) operations that no one else knows very much about, an in-depth cost/benefit analysis, a comparison of the cost of the IPCC to the cost, say, of one presidential nomination campaign, maybe I might be tempted to read more.

      As it is, I have a stack of Mad Magazines I haven’t gotten to yet, that’ll be higher on my reading list.

  43. Somebody please check if London is classified as “rural” for UHI purposes? :)

    The real “clincher” is this. Imagine if a worldwide study on smoking or asbestos were suddenly to find that not only those won’t kill you prematurely, they actually increase your lifespan by 10%.

    Now of course science can always be falsified. However when one’s study’s conclusions run against something quite well-known (be it tobacco smoke, asbestos, UHI, or slower-than-light neutrinos) then one should recognize the potential momentousness of the “discovery” and focus on finding out if there’s been errors about it, rather than casually mention it as a “confirmation” (and of what?).

  44. Steven Mosher is putting up a valiant defence, not so sure about effectiveness of it.

    • Oh, Mosh will be the first one to admit that UHI is likely small; while the BEST report is far from the final word on the subject, they do narrow the window of expectations quite a bit. But there is still work to be done, so we will see what we end up with.

      • Brandon Shollenberger

        To me, this paper increases, rather than decreases, the window of expectations in regard to UHI. I’ve said a few times my best guess for UHI was it would have a magnitude of 10-20% of the observed warming. This agrees with BEST’s conclusions, except it never occurred to me the bias would be negative. That means BEST has doubled my expected range, unless I just dismiss their results out of hand.

        Then again, I’m one of those people who say 10% is not “very small” or “almost insignificant,”

      • Brandon Shollenberger

        I should probably point out the 10% figure I mentioned doesn’t include uncertainties. If you include those, you get a range from 0-20%. Personally, I cannot see how one would conclude it is almost not worth considering the possibility of a 20% error.

      • Zeke: Why would you think that the test that BEST ran has anything to do with checking for the effect of build on thermometers?

  45. I have now read the first paper on the averaging procedures. It is well done (and data and code are available, so if I want to pick nits, I can). I have considerably more confidence in these data than in the other three records.

    • Why do they use a 10 year moving average? not 5 years or 20 or something else? It seems to me it hides the recent temp stability since 1998 even though we have record high 390ppm co2 in 2011 and the most recent years are more important.

  46. Brandon Shollenberger

    I have a simple question. Does anyone know where I can find the data graphed in BEST’s temperature record? I know there is a directory with lots of data on their site, and that may have what I’m looking for, but it’s 174MB. That’s more than I can reasonably download with my internet connection, especially when I just one a single file.

    • How slow is your connection? 174Mb is relatively small. I do download/upload of files of that size pretty often on my 7Mb/S down / 1Mb/S up DSL connection. A download of that size only takes about 5 minutes or so in the real world. Uploads are quite a bit longer, but tolerable.

      • Brandon Shollenberger

        I have to say I’m rather amused at your comment about “the real world.” A lot of my neighbors would take issue with being told they aren’t living there.

        As it happens, I currently live in an area where you cannot get a good, high-speed internet connection. The two main options here are satellite and wireless. I have a wireless connection, and it is limited to one gigabyte a month. This means downloading that would consume almost 20% of the bandwidth I can use each month. Obviously, I don’t want to do that just to get single file which is probably less than 100kb.

        As a side note, there’s a difference between bandwidth (size of the data flow) and speed (quickness of the data flow). The wireless internet connection I have is quite good about speed, but bandwidth is far more limited (at any given time, and in total). The satellite options I looked into were the exact opposite, giving me much better bandwidth, but far worse speed. I know this is irrelevant to what you asked, but it’s always irked me that people use “fast” and “slow” in regard to bandwidth as though the actual speed is irrelevant. To a gamer, bandwidth is good, but speed is vital (it’s what controls your lag).

      • The terminology is bandwidth vs. latency. And you are correct on it. I got in on the Verizon data plan before they limited it, so I pay $30/mo for an unlimited data plan. Ain’t gonna change it until they make me! I use it to stream music from a favorite radio station a long, long way from here, although generally only in my car, and eat up a lot of bandwidth that way.

        If you are looking for the data for the whole record though, the text dataset is actually 203Mb — I’m downloading it right now. It is a zip file, so I don’t think it will get any smaller. The Matlab dataset is 103Mb. If you want an copy, send me your address at johnsully at hotmal dot com and I’ll send it to you on a CD.

      • Brandon Shollenberger

        First, you have no idea how jealous I am of your data plan. Second, latency is a measure of how much the signal slows down, so it doesn’t directly describe the speed of the signal. The difference doesn’t change much, but it does make the comparison between bandwidth and speed more direct than the one between bandwidth and latency. Of course, we all know what each other is talking about, so it doesn’t matter.

        Anyway, thanks for your offer to send me the data on a CD, but it’s really not necessary. I wasn’t looking for the entire dataset. I just want the final results. There is a graph (well, a couple graphs) on the BEST website which shows their temperature record, and I just want the numbers for it because eyeballing graphs is fraught with difficulties. As Kermit suggests, I can always use a different connection to download the full dataset if I want, but in the meantime, it would be handy to have the values for that one graph. It seems strange to think one would have to download over 100MB just to be able to graph their results, but as far as I can tell, the zip file you mentioned is the only spot you can find them.

        With that said, if you do have a file with the data used for the graph(s) on that page, I’d love it if you could e-mail it to me. It’d be far smaller than the entire dataset, so internet issues wouldn’t matter, and it would take a lot less work for you. My e-mail is just a gmail account with my name separated by a period.

      • Maybe go to a Starbucks and download it there the next time you are near civilization? They and most other cafes have good speeds.

      • Brandon Shollenberger

        I’m not a fan of coffee, but it has been a while since I spent time in a Barnes & Nobles. Maybe I ought to visit one sometime next week.

  47. I think there is a lot more in the Muller report that meets the eye

    1) It notes great variability in climate prior to 1950-this directly contradicts the view of the Met office and IPCC who say the climate in the past was much more stable. I have been pointing this out for years and asked the Met office where their claim comes from. The great variability in the climate can be seen on Dartmoor, an upland area not 10 miles from their base where evidence of warmer and cooler times than today have been written about at grreat length and the physical evidence remains to this day.
    2) I have also been pointing out for years that one third of the planet is COOLING-this was again confirmed in Mullers report but very little made of it. The Ipcc say that other than South Greenland and a few places in the tropics everywhere is warming. Here is an article on the cooling written by Verity Jones and myself whttp://diggingintheclay.wordpress.com/2010/09/01/in-search-of-cooling-trends/
    3) The uhi effect and station move have created entirely different micro climates over the years-we have known about UHI since Roman times-it was NOT first noted in 1833. It is counter intuitive to me that we should take known uhi affected temperature stations and spread that amongst areas that don’t even have stations. I guess that is an artifice of the grid system
    4) As regards the warming since 1950, I don’t disagree, but we once again see someone measuring from a trough. The period 1950 -1970 was cold.
    http://data.giss.nasa.gov/gistemp/graphs/
    5) As Judith Curry notes there is great uncertainty over SSTs.

    tonyb

  48. At first glance, two of the papers appear to contradict each other.
    Paper 1 says that there is no evidence that global warming has abated since 1998.
    Paper 4 fig 1 shows cooling of at least 0.2C since 1998.

    • Brandon Shollenberger

      I noticed the same issue, but then I looked closer. The figure you refer to from Paper 4 isn’t BEST’s temperature record. It’s a record they generated by using only a fraction of the stations they had (2,000 stations not used by the other groups releasing temperature records). There will obviously be differences between that and the record they get when using all the stations. To get an idea of the difference, look at Figure 8 of their first paper.

      That said, I really have no idea why they used a subset of their data in that figure in the fourth paper. I can’t find any explanation in the text, and none come to mind. It seems completely random, so it’s hardly surprising people might not catch it.

      • Yes, that’s right, I think they wanted to use data that was independent of the other groups (see Roger Pielke’s comment earlier). So as you say it is not a direct contradiction, but still an interesting anomaly.

        It is not clear what the source of these 2000 records is, in paper 4. This is something that certainly needs to be fixed in the text.

      • Brandon Shollenberger

        The paper does call the independence a “virtue,” which makes a certain amount of sense, but it still leaves the question of why only use 2,000 stations? All it seems to do is raise additional issues. For example, the paper says the four lines being compared are broadly consistent, but just look at the 1960s. Ultimately, they could have done the same comparison with 4,000, or even 20,000 stations without changing anything in their paper except for making the line more accurate. Given that, I can’t see why they made the figure they made.

        That said, it is certainly interesting to see such large differences between that subset of their data and the full data set. It makes me wonder just how many stations are needed to actually get the “right” results. I’ve heard a number of people, such as Mosher, say relatively few stations are necessary for coming up with the temperature record, but this seems to be pretty clear evidence you need a lot of them.

        As a side note, I find the description of how they generated that line both amusing and confusing. I’m curious just what level of precision they were trying to convey:

        We obtained this estimate by choosing 2000 sites randomly from a list of approximately 30,964 temperature recording stations world‐wide that had not been used by NOAA, GISS, or HadCRU.

  49. It may every now ant then be good to think again, why the temperature time series are of interest an what kind of time series provide most useful information. Often it’s useful to consider several complementary time series, which each provide or some additional relevant information to supplement the others.

    The temperatures at all points of the Earth surface do not have equal significance. The temperature variations are exceptionally large at some locations at some particular times of year and day (like Arctic or near Arctic winter nights), but all have the same weight for the same surface area in the global average surface temperature. In particular the polar areas and other Arctic areas in Siberia, Canada and Greenland may have exceptionally large temperature variations, but rather little overall importance. That’s just an example on the fact, that the global AST does not necessarily represent best either the most important real trends nor the significance of these trends.

    The global AST is also difficult to determine from the existing data. The oceans may be largest problem, but also the wide Arctic areas influence the outcome and are a major factor in the differences between existing time series.

    The global temperature is the most natural concept to define, but some more limited average temperatures may actually reflect better the significance of the temperature changes and be easier to estimate. The longer time series are much more reliable and accurate, when the area covered is reduced.

    One of the more meaningful variables is the total heat content of the Earth system, but it’s difficult to determine and long time series are impossible to obtain. That raises the question of the best proxies for that. Are the proxies improved, when areal coverage is increased with sparse and problematic data which is given a great weight based on the wide areas for which no better data exists? I don’t know, but I doubt.

    The choice is often between data of better accuracy with lesser coverage and of essentially lower quality with wider coverage. When there are good reasons to conclude that, what we want to know is the full coverage, there isn’t much choice, but with the temperature data the full global average isn’t necessarily even the most relevant data series.

    The oceans are an exceptionally interesting case from the scientific point of view due to the nature of available data. I can believe that there’s still much to do in extracting useful knowledge from the historical data. Again it’s not likely that any single time series is able to summarize optimally the information, but there may be several alternative approaches with their strong and weak points. That’s an area, where a cooperation of statisticians and substance experts may be very valuable. They should really search for best ways of summarizing the information without preset restrictions on what the time series should represent.

  50. Bart R: you haven’t read a thing about omnology, Donna’s book, my reply to you, or the BEST UHI paper. What’s left? The yellow pages?

    • Omnologos — My word! You weren’t being intentionally ironic!

      Nomology is a real word; “omnology”, just a spoof of Scientology.

      And while your list of reading materials may be nearly exhaustive to your mind, one remarks the yellow pages (which from time to time I do read through), the BEST UHI pre-release (which I’ve gone over a couple or three times), your replies and the book in question don’t really add up to much of a foundation for drawing logical conclusions about anything.

      How could anyone who values logic or pretends to “omnology” find a one-sided and narrow treatment of anything, much less of an enterprise that is dedicated to casting a wide net of scientific reasoning and presenting the most up-to-date and coherent reports on a broad field as possible, anything but antithetical?

      Oh, the hypocrisy.

  51. Tomas Milanovic

    Judith wrote:

    In concluding, I will remind everyone that the REAL problem with the surface temperature data set lies with the ocean data.

    Yes and to emphasize and generalize this comment I would say that the REAL problem is with the spatial distributions.

    I have always thought that this work was a very minor and largely insignificant contribution to the understanding of the system’s dynamics.
    Getting a “new”, more “reliable” way to compute a spatial average of a finite number of data randomly distributed in space?
    An interesting statistical exercice but largely irrelevant.
    Finding that 1/3 of the points have cooled while 2/3 have warmed, the total giving (obviously) a warming?
    L.Motl has found that first already 3 months ago (http://motls.blogspot.com/2011/07/hadcrut3-30-of-stations-recorded.html) even without BEST methodology but he asked the right question : why is there a large number of points which cool ?

    Where is a convincing argument that a spatial global temperature average is in ANY way relevant to the dynamics? Where are the spatially localised oscillations at llow frequency inthe global averaging?

    As this number (spatially averaged temperature) has no relevance for the dynamics and for the accurate predictions at long time scales then this study is an interesting statistical exercice with no practical interest.

    I have never been interested by those hundreds of “studies” that all just take the data and then basically only do averages.
    I have always known that this exercice will always give a
    single number which will be the more or less the same for all methods because they simply must all use the same data.
    Well yes, there is certainly an UHI but, again, it is uninteresting to know what is some second order effect on an irrelevant parameter.

    Now if they used the data to spatially identify and characterise multi decadal oscillations, for instance by testing the Tsonis hypothesis, then it would be a bit more interesting. Or if they looked in depth on spatial correlations.

    If its is only an Nth attempt to say that GlobalT(t2) – GlobalT(t1) = 0,x °C, and pretend to be enthousiastic because we got the sign of an irrelevant number with a 3 sigma confidence, color me unimpressed.

    • Mr. Milanovic, could not agree more. (your final paragraph made my day!)

    • Tomas Milanovic

      One must admit, the standard of “impresses Tomas” is too strict by many times a metric.

      How many times in a century would such a rarefied measure be met?

      It would be awe-inspiring were the dataset you seek available, and yet no one had made every effort to assemble it, for the two century span of time BEST covers.

      What was done instead, BEST assembled a fit-to-(some)-purpose dataset out of what actually was available.

      While it can be (maybe) determined what the minimum number of dynamically significant datapoints for the purposes you describe, I’m dubious even current satellites and methods could produce the beginning of such an information collection.

      Why talk about what we cannot have, when if we’re clever we can find some advantage in what we do have?

      Besides, you have yet to demonstrate how the considerations you mention are likely to apply on the timescales that matter to AGW.

    • Thomas Milanovic: As this number (spatially averaged temperature) has no relevance for the dynamics and for the accurate predictions at long time scales then this study is an interesting statistical exercice with no practical interest.

      The location of the center of gravity of a passenger aircraft also gives no information about its dynamics, but a sequence of such locations can tell you its destination and time of arrival. It is possible that a sequence of mean earth surface temperatures might tell us what to expect globally in the next few decades. Mean earth surface temperature, and the related climate sensitivity to a doubling of CO2 are not intrinsically meaningless; not any more than the location and fuel of the aircraft.

      I believe it has not been adequately demonstrated that the mean temperature record and CO2 sensitivity are as useful as aircraft location and fuel, but the ideas are not intrinsically meaningless.

      why is there a large number of points which cool ?

      I believe that this question must be investigated. Are there any consistent differences between warming and cooling locations? Can we account for heat transfers? Do the confirmable mechanisms have implications for mechanisms of CO2 effects (in different places or at different altitudes.) If everyone agrees that BEST is the best effort of its kind to date, and especially if AGW advocates call it good work, then BEST will focus attention on that question. It’s intuitively unlikely (for what that’s worth) that the differences between warming locations and cooling locations are either random or irrelevant.

  52. Allmost everybody believes that there has been warming, but what causes it is diffrent issue. Nobody knows for shure about Sun’s affection to climate still IPCC says it’s not the sun, it’s CO2. I believe Spencer is right when he says that climate sensitivity to CO2 is low. I still believe i’ts the Sun after all.

  53. Tomas Milanovic

    Sorry for the bad use of the arrow brackets.

  54. Brandon Shollenberger

    I just noticed another strange thing about the UHI paper, though this one isn’t as important. Table 1 in the paper says there are 38,898 total sites used, 16,068 of which are “very rural.” Earlier in the paper it gave those values as 39,028 and 16,132.

    I can’t find any explanation as to why 130 and 64 sites were excluded from the calculations.

    • Brandon Shollenberger

      Relevant to this point is the abstract, which explicitly states:

      The effect of urban heating on estimates of global average land surface temperature is studied by applying an urban-rural classification based on MODIS satellite data to the Berkeley Earth temperature dataset compilation of 39,028 sites from 10 different publicly available sources. We compare the distribution of linear temperature trends for these sites to the distribution for a rural subset of 16,132 sites chosen to be distant from all MODISidentified urban areas.

  55. Make yourselves ready! Bishop Hill has the following:-

    http://www.bishop-hill.net/blog/2011/10/21/keenans-response-to-the-best-paper.html

    “Keenan’s response to the BEST paper”

    “Doug Keenan has posted up his correspondence with the Economist and Richard Muller about the BEST paper. I reproduce it here with permission.”

    A lot to go through and comprehend

    • I’m amazed and thunderstruck at the absurdity of some correspondents to try to convey that this study somehow trumps skepticism. This is madness, plain and simple.

      Judy, you are going to have to talk to the good Doctor about his loose lips. We’ve got a ship to keep afloat for the voyage.
      ================

    • Muller’s found something right because he sneers at finding something wrong.
      ===============

  56. I probably shouldn’t want to intrude into private grief – but I do!

    This graph says it all really.

    http://news.bbcimg.co.uk/media/images/56197000/gif/_56197115_climate_change_624gr.gif

  57. So what have we learnt?

    Well our themometers, the same thermometers as before, show that the world has warmed over the past 200 years.

    Take a bow Muller & Curry for stating the obvious. Nobel prize in the post.

    Now what of attribution?

    After some length Muller eventually stated, “How much of the warming is due to humans and what will be the likely effects? We made no independent assessment of that.”

    My good lord!

    Right around the planet Muller, Curry et al, have given the impression to journalists, to the politcians and to the public that AGW has been cuplable in excessively warming the planet, but by their own belated confession now admit “We made no independent assessment of that.”

    Now that is devious.

    Is this BEST’s version of Manns-Jones trick? They got caught hiding contrary data from scrutiny, whilst BEST appears to have attempted to hide a very important caveat that somehow got lost in this PR exercise.

    This is not science, but maybe that was the intention.

    The jury is still out on attribution, but who is now listening to those diliberations?

    Muller – FAIL

    Curry – FAIL

    • Brandon Shollenberger

      BEST used something like thirty thousand stations the other groups didn’t use. If you cannot get basic facts straight, it’s hard to expect anyone to take you seriously.

      • Same data source, not an independent source, so it makes no difference how many stations were used or not – the planet has warmed – which is something we are now being told we didn’t know or didn’t accept before.

        Now we are either dealing with a straw-man arguement or revisionism,or both. Either ways it is devious to imply that is due to AGW when Muller was forced to admit, ““How much of the warming is due to humans and what will be the likely effects? We made no independent assessment of that.”

      • Brandon Shollenberger

        So you’ve changed your story from “same thermometers” to “same source,” and yet, you’re still just making things up. Tell me, just what is this “same source” being used?

      • I half suspect Muller deceived himself. Reading the ClimateGate emails made him suspect the temperature record and he’s settled his doubts on that score. What perhaps deceived him is an industrial strength belief in the correctness of the IPCC’s understanding of CO2’s radiative effect in climate.

        Otherwise, I’m bamboozled, and just as outraged as you are at the straw man/revisionism on display.

        Keep an eye on future temps, and wonder what Fig. 1 in Paper 4 means to Muller.
        =============

      • Brandon Shollenberger

        I need to post a partial retraction of what I said above. It turns out one of BEST’s papers does use GHCN entirely for its data. I didn’t realize this before as I had focused on the other papers which used BEST’s new dataset. This doesn’t make Mac right, especially in regards to his tone, but it does make the tone of my comments unjustified. For that, I apologize.

        Of course, it’s clear Mac didn’t know what he was talking about, otherwise he would have pointed out my mistake in his first response to me. I was right to think he wasn’t bothering to learn the facts; I was just wrong to think those facts were so simple.

      • My tone is bang on.

        Did you believe that the world had warmed prior to BEST?

        Do you still believe that the world has warmed after BEST reported?

        Did you doubt?

        Now here is the Economist headline;

        “The heat is on – A new analysis of the temperature record leaves little room for the doubters. The world is warming”

        Who were these doubters????????????????

        BEST did not feature two very important caveats;

        1. This was not a truly independent verification that the world has warmed – it used the same data and came up with the same answer.

        2. This was not a test of attribution.

        However from reading blurb in the mediayou would have thought that BEST was saying the opposite. We are left in no ‘doubt’ that humanity is to blame for the current warming.

        Now that is devious.

      • Lord Beaverbrook

        Surely the point that Keenan is trying to make, over at Bishop Hill, is that the linear models are expecting TSI to have a linear trend so the satellite data is adjusted to fit that trend.
        In reality the Sun is cyclical so it’s effects must be cyclical, which differs from what the models are expecting because they require a linear trend.
        The data stipulates cyclical the models stiputate linear so what happens, the data is adjusted to fit the model requirements instead of the the models are adjusted to fit the cyclical data.
        A quick search gives some detail:

        http://icecap.us/images/uploads/Lockwood_and_Frolich_Review.pdf
        Or am I missing something?

    • Mac –

      There has been much criticism among “skeptics” of previous assessment made WRT recent warming on the basis of failure to account for the potentially corrupting influence of an UHI effect, or the statistical methodology used by the “climate community” to assess trends in land temperatures. These criticisms asserted that for those reasons, the existing analyses of the recorded data did not validly show recent warming, let alone the degree of recent warming. Hence, the criticisms were rooted in a view that questioned recent warming – and on that basis justified “skepticism.”

      From reading comments from “skeptics” at various websites, I have seen exactly that basis for skepticism expressed many, many times.

      The BEST analysis controlled for the UHI effect, and used a different statistical methodology that addressed (at least some of) what some critics felt were methodological flaws in previous analyses.

      Assuming that you accept the BEST methodology as valid – and you were a “skeptic” for the reasons I described above, then you would, theoretically, no longer be skeptical. If you were a “skeptic” who doubted AGW, not because of questions about the “climate community’s” analyses showing warming, or about the “climate community’s” assessments of the degree of recent warming, but simply on a questioning of whether the recent warming is attributable to anthropogenic CO2 emissions – then obviously, BEST’s work would not change your “skepticism.”

  58. I’m a little curious how you expect someone who sneers at finding something wrong, to find something wrong.
    ===============

  59. Stephen Wilde

    “why is there a large number of points which cool ?”

    Simply because perceived climate change is a consequence of a redistribution of the climate zones as they jostle about in the process of speeding up or slowing down the rate of energy loss to space in a powerfully negative system response to ANY forcing of temperature from ANY internal or external source.

    With that process going on some places warm up and other places cool down as they change their positions relative to the nearest climate zones. More or less cloudiness, more or less sunshine, more or less wind from oceans, more or less wind from land masses etc. etc.

    If the globe is trying to accumulate more energy for whatever reason the climate zones realign to get rid of it primarily by altering the speed and/or volume of the water cycle. There might be a net globally averaged overall surface warming for locations in the troposphere but not necessarily any significant warming (or total energy content) for the system as a whole which must include the oceans from surface to depths.

    The data shown just provides evidence for a slight long term surface warming trend in the regions (mostly northern hemisphere, mid latitude continental) where any changes would be most apparent from surface observation recorded by thermometers. That trend clearly going right back to the LIA perhaps supplemented a bit in recent years by the UHI effect.

    It does not follow trhat there is necessarily any significant increase in total system energy content.

    • Richard Saumarez

      I could imagine that global warming could melt polar ice, thus “disappearing” in the latent heat of melting, increased cold water would arive in the temperate regions, and so lower temperatures in the local climate.

      Whether this is true or not, I’ve no idea, but I imagine that the relationship between a global positive radiation balance and regional climate is going to be complex.

    • It does not follow trhat there is necessarily any significant increase in total system energy content.

      Just to clarify then – assuming that you are a “skeptic,” that means that you doubt whether the world is warming.

      Correct? Because I’ve been told that “skeptics” don’t doubt that the world is warming.

      • I don’t doubt that some portions of the surface have warmed but there is no evidence that total system energy content has increased significantly taking into account the entire body of the oceans.

        From the point of the entire system we could just be seeing faster energy flow from negative system responses such as the faster or larger water cycle through a small portion of the system offsetting the slower flow from more GHGs.

      • Just to clarify then – assuming that you are a “skeptic,” that means that you doubt whether the world is warming.

      • Depends on your definitions.Your terms are too imprecise to allow for a definitive response.

        A tiny amount of energy is retained in the system for a fraction longer by GHGs but the amount due to humans is infinitesimal as against naturally varying CO2 flows plus solar and oceanic effects.

        Any warming there has been is therefore more likely sun and ocean induced than a consequence of human emissions.

        And warming of one part of the system is not necessarily significant if it fails to measurably warm up the system as a whole due to negative system responses.

      • Lots of misconceptions there.

        From the point of the entire system we could just be seeing faster energy flow from negative system responses such as the faster or larger water cycle through a small portion of the system offsetting the slower flow from more GHGs.

        GHG will contribute immediately as the energy is transferred quickly via statistical physics of gas particles.

        A tiny amount of energy is retained in the system for a fraction longer by GHGs but the amount due to humans is infinitesimal as against naturally varying CO2 flows plus solar and oceanic effects.

        Bogus. Uptake and release are slow diffusional processes when it comes to excess concentrations. CO2 diffusing to sequestering sites and excess thermal energy diffusing show similar random walk dynamics, the first random step is what fools everyone. Do you actually study or have any experience with the laws of mass balance and conservation?

      • The world is warming AND cooling, depending on time scale. Temperatures are used as the measure of this warming/cooling. Change in temperatures is not necessarily proportional to the change in energy content of the system.

      • Edim –

        I’m confused. Just recently you told me that “Anthony was right” when he said that skeptics don’t question whether the “world is warming.”

        Now here you indicate that you believe that the world is “warming AND cooling.”

        I don’t think that I’m being overly semantical here by seeing a conflict in your most recent statement and your previous statement.

        Anthony’s statement clearly meant that “skeptics” don’t question whether or not in balance -small, or regional variations notwithstanding – there is a mathematically valid trend of warming. That would imply that “skeptics” would not answer a question of “Is the world warming,” with an answer of “It is warming AND cooling.” But an answer of “Yes, the world is warming.”

      • Joshua,

        An important problem with the skeptikal position (with two K’s, pretty please with some sugar on it) is that we rarely take the time to identify what one is skeptikal about. For you see, there are an indefinite amount of subject matter about which one can be skeptikal. Here are some examples:

        One can be skeptikal about the very existence of a temperature average.

        One can be skeptikal about the warming of surface-land in recent centuries.

        One can be skeptikal about the quality of the land-surface temperature data we have.

        One can be skeptikal about the importance of such questions when compared to the Very Real Green Menace.

        There are lots of positions about which one can be skeptikal.

        * * *

        So we now know that Anthony Watts never doubted that there was a surface-land warming. That is, we now know that Anthony Watts position is compatible with the proposition according to which there MAY have been a warming of 0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001
        Celcius during the recent century or so.

        Anthony Watt’s skeptikism is about HOW MUCH warming there really were.

        * * *

        What we do not know from Anthony’s last post, is where he stands regarding his previous skeptikism regarding the quality of land-surface measurement data we have.

        Anthony Watts does seem skeptikal about the priority of such questions when compared to the Very Bad PR Strategies BEST is showing.

        * * *

        What can be noted is that all the skeptikal position are quite independent from each other. Not only are there indefinite skeptikal positions, there are indefinite combinations of skeptikal positions. Some Mainstream Mathematicians believe there are more combinations than there are positions, but they’re all Krooks bought by the Realist Church.

        That these positions are all independent from each other is quite obvious from the fact that we do observe an indefinite combination of skeptikism in blogland. IF, and that is a big IF, there are logical impediments prohibiting for a skeptikal agent to entertain two skeptikal positions, there is nothing that prevents to share the skeptikal work among many skeptiks.

        I hope this MAY BE of help to understand your problem,

        w

      • > The world is warming AND cooling, depending on time scale.

        A lukewarm answer.

      • Sure – the world is warming AND cooling in the sense that on various time scales, at various places on the globe, even as I type, temperatures are rising and falling.

        The statement that the world is warming and cooling depending on time scale, is essentially trivial.

        The non-trivial questions at hand are: what has been happening, in balance, over the past 50 years, how does that differ from previous trends (by sign and degree), what are the variables that might explain any differences that might exist, and is anthropogenic CO2 the most likely (or perhaps the only possible) explanatory variable for differences that might exist?

        Anthony’s statement is that “skeptics” don’t question whether the “world is warming.” That would clearly imply that “skeptics” don’t doubt that the recent trend, in balance, is one of warming.

        If your answer to that simple question is in any way ambiguous, and you are a “skeptic,” then Anthony’s statement is wrong with respect to your opinion.

        Anthony did not say that “skeptics” don’t doubt that the world is warming and cooling.

        If your answer to that simple question is that you don’t think that the methodology of the analyses that have been conducted are valid, then there again, if your are a “skeptic,” then Anthony’s statement is wrong with respect to your opinion (as you would have no basis for belief, one way or the other, as to whether the “world is warming,” although you could point to evidence of past climate change to say that it is likely that the world is warming AND cooling.

        Look – what “skeptics” as a group do or don’t believe isn’t really that important with respect to the science. And Anthony’s opinion is just one person’s opinion, and as such it is largely irrelevant. But in terms of the climate debate, it is relevant if some significant number of “skeptics” regularly mischaracterize other “skeptics.”

        The conflict between Anthony’s statement and what I see written in comments from “skeptics” all over the blogosphere becomes significant because I see that same inconsistency all the time.

        Time after time I am told that “skeptics” don’t question whether the world is warming – they only question the degree and the attribution. Our very gracious host has, herself, endorsed that characterization.

        Polls show that a very significant % of Republicans and Tea Partiers – who presumably could be referred to as “skeptics,” don’t think that the world is warming.

        What do you suppose is the explanation for such a widespread and repeated mischaracterization of the viewpoints of “skeptics?”

      • Joshua,

        I’ve replied to this in the wrong sub-sub-sub-sub-thread:

        http://judithcurry.com/2011/10/20/berkeley-surface-temperatures-released/#comment-125465

      • Thanks, willard –

        For the benefit of Richard Saumarez, I’ll respond later. I wouldn’t want the poor fella to be forced to endure another of my posts without a break.

  60. It’s always been about the attribution. Is that just now dawning on them?

    Frankly unbelievable. So why the perception that they’ve been so clueless?

    It’s like Muller is writing a review of the book ‘Climate Skepticism’, but fails to buy, download, or read the book.

    He’s documented that the typescript is the same as previous editions, but otherwise leaves the book unexamined.

    The work is not a waste of time and money, but the jumped up spin, the pumped up kick, is lethally self-destructive.
    ============

  61. Okay here are two questions.

    How many people believed that the world has warmed over the past 200 years before BEST published their results?

    How many people now believe now that the world has warmed over the past 200 years after BEST published their results?

    If your answer is Yes-Yes take a bow.

    If your answer is No-Yes you won’t be able to take a bow because you are made of straw.

    That is the basis of the BEST project.

  62. And we’re talking about papers that are not even peer reviewed yet – so applying “the team” standard for truth – I can safely claim that the conclusions of these four papers are false – without even reading them. And obviously “the team” doesn’t have any pull at WSJ or else the op-ed would not have been published at all.

  63. Richard Saumarez

    I’ve been looking at the GHCN data from a different perspective, some might say from a rather limited signal processing approach (see post), so I wasn’t looking at the data from a global trend standpoint. Yesterday, I did a quality control exercise. By selecting 15 stations at random, 4 had series that lasted nearly a century, but contained minimal data, 3 had unexplained “jumps” in the data of well over 2oC ,two showed negative trends and the rest showed positive trends in region of 1.2 C/century. Were one asked to make a judgement on data of this quality in process control or medicine, one would might question the quality of the data.

    The primary data appears to me to be somewhat uncertain. I am well aware that statistics is the art of making judgements in the light of uncertainty, but I do worry about the quality of some the primary data.

    Having said that I am in no doubt that the “global mean temperature” is rising and has been doing so for some time.

    I think the historical record is in interesting as history. I don’t imagine that anyone with any sense is going to dispute the broad brush findings of these studies. What appears to me to be far more important is that the climate community is starting to gather far higher quality data with satellites that can address the problems of radiation balance, clouds, regional atmospheric temperature profiles, humidity. Given detailed geographic data from satellites and, I presume, increasing resolution of satellite temperature measurement, I guess that in 10-20 years this will give a much clearer picture of what the climate is doing than historical instrumental temperatures.

    • Brandon Shollenberger

      One of the most important parts of BEST’s work, to me at least, was it was going to include a large amount of data GHCN didn’t include. After all, a 400% increase in data is great one is looking for a signal in “noisy” data.

      Unfortunately, they apparently aren’t publishing the results they got with that new data just yet. Or rather, they’re publishing partial results, but not the full ones.

    • Richard, I would like to sample some stations data as you did, how do I get it?
      I have looked at WolframAlpha’s historical weather data for specific cities and stations and it often jumps and often has data gaps too.

  64. Brandon Shollenberger

    I have another issue with the UHI paper. It’s second section begins by saying:

    The analysis presented here is based on merged monthly average temperatures from the Berkeley Earth Surface Temperature Study dataset. This dataset consists of measurements from 39,028 unique stations, which are merged from 10 preexisting data archives (Rohde et al., 2011).

    However, the paper they cite says this:

    In another paper, we will report on the results of analyzing a much larger data set based on a merging of most of the world’s openly available digitized data, consisting of data taken at over 39,000 stations, more than 5 times larger than the data set used by NOAA.

    It seems the citation is bogus. As far as I can tell, there is nothing in the paper they cite which discusses the formation of their dataset. At best, all the paper they cite does is make vague references to to the material it is supposed to be providing.

  65. Hi Judy

    I wrote this comment on Watts Up With That in response to comments from Zeke Hausfather-

    “Zeke Hausfather – I realize that he has a much larger set of locations, but many of them are very short term in duration (as I read from his write up). Moreover, if they are in nearly the same geographic location as the GHCN sites, they are not providing much independent new information.

    What I would like to see is a map with the GHCN sites and with the added sites from Muller et al. The years of record for his added sites should be given. Also, were the GHCN sites excluded when they did their trend assessment? If not, and the results are weighted by the years of record, this would bias the results towards the GHCN trends.

    The evaluation of the degree of indepenence of the Muller et al sites from the GHCN needs to be quantified.

    Perhaps they have done these evaluations. However, from my reading of their work, I have not yet seen it.”

    • I have made a KMZ file of the 36700 odd BEST sites. This is a Google Earth file – if you click on it’s name, it will bring up GE with all the sites marked. There are flags with info, got by clicking on the pushpin markers.
      It is accessible from here.

      .When I get further into the data, I’ll make one with the years of data indicated, with folders and colors, and also the GHCN stations. I could do GHCN now, but it isn’t very meaningful without the duration of data info.

      • steven mosher

        Nick did you find 36K in the best file?

      • Steven, I found 36736 stations in the inventory, and I’m now in the data file data.txt. 35121 stations there have at least one month with more than 10 days data.

      • Steven,
        I found the 10 days in a month test is no good, because the number of days is unavailable for a lot of stations. Without it, in the latest data, almost all stations have at least some data, 39026 out of 39056. I’ve updated the KMZ file.

      • cool

      • I’ve put up a new KMZ file which has more of what Dr Pielke is looking for. It has the years of data info, and the four data sets BEST, GHCN, GSOD and CRUTEM3. The markers are colored, sized and foldered. The folders let you look at many different subsets.

  66. Richard Saumarez

    I think that one has to be very careful about the implications of the temperature history of Earth, when thinking about this data.

    The error limits on the data in say 1850, are considerably wider than they are today. If one were ask, what was the change in mean surface temperature between 1830 and 1880, and is this comparable to today, could one answer this question? I think not, because there isn’t nearly enough data to enable one to answer it.

    I would suspect that the temperature record in this study is interpretable in mean global terms for about a century and probably only “hard” for a shorter period. Therefore I would be reluctant to make arguments about the implications of the recent temperature excursion, which I am sure is rea,l in terms of whether it is unusual in terms of a longer time frame.

    This is not meant as a criticism of these studies which are designed to synthesise conclusions from the existing data as accurately as possible.

    • Richard, what recent “excursion” are you talking about? Do you mean the 1978-97 warming? The satellites do not show it and they are instruments, not arcane statistical models. I doubt it is real.
      http://www.mediafire.com/file/a9tv9tad9e6216p/UAH_2011_06_19_two_regressions.pdf

      • Richard Saumarez

        See my post at 8.52 re data quality and satellites.

        I am prepared to believe that there is warming in the instrumental temperature record. How this relate to the overall land temperature, I am less certain.

      • Richard Saumarez

        I am shocked by your statement (well actually not all!). In my last post, I got dumped on by a couple of trolls who disrupted the entire thread, so I am being careful not to make deliberate troll-baiting statements. Not that I think their opinions are particularly interesting or correct. If you haven’t discovered it, you should go to “The Idiot Tracker” home website of “Robert” and have a look at the psychopathology on display. From a purely psychiatric point of view, one should avoid becoming a victim of these individuals’ paranoia.

      • What shocked you? I think the satellite record falsifies the surface statistical models, that is all. These Jones type area averaging models are mathematically strange to begin with, so I fail to see the shock value in my statement.

      • Richard Saumarez

        I was being purely ironic.

      • Richard Saumarez

        I should add that I think that the divergence of satellite data with the thermometer data is of great importance. I am certainly not a standard bearer for the somewhat questionable approaches of dubious interpolation based on correlation, the methods of data reduction used (see my thread on Aliasing) and I am somewhat sceptical about Kriging, having used it on some data sets.

        As I said in a previous post – I believe satellite data will be vastly more important and physically important in determining major issues such as overall radiation balance.

      • Thanks Richard. As a Spock-like logician I have no ear for irony. It often escapes me.

      • These Jones type area averaging models are mathematically strange to begin with, so I fail to see the shock value in my statement.

        The hero and mineral exploration veteran McIntyre will come to the rescue and teach everyone about kriging. It is widely used in that field because mineral core samples are very expensive measurements and they have to get by with strategically placed samples. Of course there are well known predictive disasters but this is a lot different than the gampling involved in prospecting. In the kind of kriging used for temperature estimation, they are not betting the farm on where to place a mine but more like performing optimal extrapolation for lots of missing spatial data points. Those will regress to the mean as the law of large numbers takes effect.

      • Richard,
        Thank you for taking the time to comment here.
        I have two questions for you from your experience in measuring sensitive biological systems and applying sophisticated statistical tools:

        1-How signficant is 0.45C* over >20 year period of time in a dynamic system that has daily fluctuations often in the 10 X degree range, and inter-day changes that are frequently multiples of a degree range?

        *granting a recent claim made on this blog as fully correct.
        2- The second question may be out of an area you wish to consider, but I think your opinion would be valuable:
        How meaningful and useful is the concept of ‘global temperature’ or ‘global climate’?
        It is not uncommonn for there to exist simulataneous areas of Earth experiencing record heat and cold. It seems that regions of the Earth is where people and life exist, not globally per se. I may not be expressing this clearly, and if not please advise.
        Regards,

      • David,

        Do you really think there’s a big difference between satellite TLT trends and those from surface records? It seems to me they are very similar and any differences between the featured four do not seem dependent on a satellite/surface divide.

        Thermometers are instruments too. Producing a global temperature map from a series of moving measurement platforms is a complex process, particularly so for the lower troposphere because you have to look through the rest of the atmosphere to get at it. This is a process that will necessarily involve statistical models, whether they are arcane or not.

      • Paul, the surface models show steady warming from 1978 to 1997, while the UAH shows none. That is a big difference in my book. Especially since this supposed 20 year warming spurt is the only warming in the last 70 years in the surface models.

        The issues with the satellite readings pale to insignificance compared to the issues with the surface models, beginning with the fact that this is a convenience sample. It is fundamental to statistical sampling theory that you can draw no firm conclusions fro a convenience sample.

      • Paul, the surface models show steady warming from 1978 to 1997, while the UAH shows none.

        But RSS does show warming, about as much as the surface records. As I said, there are short term differences between them all but no strong satellite/surface divide.

        Especially since this supposed 20 year warming spurt is the only warming in the last 70 years in the surface models.

        Huh? How about the warming from 1984-2003, from 1989-2008, if we stick to 20 year periods.

        The issues with the satellite readings pale to insignificance compared to the issues with the surface models

        I don’t think so. There are potential issues with both, but they seem to have been largely overcome. If you think the surface record is more problematic why do you think it was that the UAH record was reporting erroneous trends for several years?

      • I have no use for RSS. It was cooked up by people who did not like the UAH readings. And HadCRU shows no warming trend from 1984-2003, nor from 1989-2008. The only warming period it shows in the last 70 years is roughly 1978-1998, where UAH shows no warming at all.

        Of course you could try to eliminate the contradiction by saying both UAH and HadCRU are no good. That is basically what the NAS/NRC did. But then it means we have no idea if it is warming or not.

      • I have no use for RSS. It was cooked up by people who did not like the UAH readings.

        The UAH record was incontrovertibly wrong at the time RSS came along with their TLT record. Christy and Spencer have admitted as much. My question is how could they have made such a mistake if satellite measurements are so plain and simple compared to the arcane ‘surface models’.

        HAdCRUT3v trends from 1984-2003 and 1989-2008: http://www.woodfortrees.org/plot/hadcrut3vgl/from:1984/to:2009/plot/hadcrut3vgl/from:1984/to:2004/trend/plot/hadcrut3vgl/from:1989/to:2009/trend. There seems to plenty of warming to go around there.

      • David Wojick writes: HadCRU shows no warming trend from 1984-2003, nor from 1989-2008.

        HADCRU shows a warming of approximately 0.45C from 1984-2003 (by OLS). This is a slightly larger warming than GISSTEMP has for the same time period.

        It shows a warming of about 0.36C from 1989-2008. This is just slightly less warming than GISSTEMP shows for the same years.

      • Whoops, it looks like Paul S beat me to it there. Sorry for the redundancy.

      • david do you accept the PHYSICS models used to create the satellite temperature products

      • The satellites do not show it and they are instruments, not arcane statistical models.

        My pool was registering 71 °F this morning, and 73 °F later in the day. An arcane statistical model claimed that its average temperature over that period was 72 °F. Next time I’ll use instruments, not arcane statistical models.

        I love the logic skeptics use.

      • Better yet, they dont realize that satellite temperature products RELY on radiative transfer equations

    • Synthesizing bad data as accurately as possible is an oxymoron.

      • David –

        Do you think that the “world is warming?”

      • Joshua, the satellite measurements indicate a step function warming coincident with the 1998-2001 ENSO cycle. See http://www.mediafire.com/file/a9tv9tad9e6216p/UAH_2011_06_19_two_regressions.pdf That single event of warming is probably real, so in this limited sense the world is indeed warming a bit.

        Prior to 1978 we do not know, but we know that the supposed warming from 1978-97 did not in fact occur. This is the supposed warming that AGW is now based on. So I neither think the world is warming over the long run nor do I think it is not, but I do think AGW has been falsified by the satellite data.

        I also believe that we have an entire scientific community trying to explain a statistical fantasy, in order to support a political movement. That is the real problem, not whether or not it is warming a bit.

      • David –

        So – as I understand it, you trust the satellite data as valid, but you do not trust surface temperature data – and thus, you would question any assessment that the “world is warming.”

        I commend you for having an opinion that remains consistent. However, your opinion would suggest that it is not only the “scientific community trying to explain a statistical fantasy in order to support a political movement” that is mistaken in their opinions about global temperatures.

        It would also be Anthony, and the many “skeptics” who say that there is no doubt that the world is warming, who you also think are trying to explain a statistical fantasy (although presumably you’d have to find another explanation for their fantasy – as their political orientation would, no doubt, be inconsistent with your thinking).

        Obviously, those other folks are, as well, either misreading the satellite data, or are trusting the surface temperature data which, no doubt, you consider to be invalid.

        Is my understanding correct?

      • Yes Joshua, you have it about right. What you are calling the surface temperature data is in fact the output of a complex computer model. It is not data at all, in the sense that data usually refers to measurements.

        I spent several years studying these models, in the context of statistical sampling theory, and I came to the conclusion that they are inaccurate at best. Far worse than the climate models. This is a math issue, not a physics issue. Most people do not even realize that these models exist. They think these so-called global average temperatures are statistical sampling averages, but they are far from that.

        However, I also participate in those debates that assume the surface models are correct, just to keep my hand in the big game. My sole goal is to stop the greens, so I have multiple lines of defense.

    • Going down this road, before the first prediction, the GCM model-makers already have become, “convinced disciples of the mathematical reductionism.” They also wish to be counted among the converted who eschew the concept that an average global temperature is meaningless because temperature is an intensive variable.

      Moreover, the AGW model-makers’ GCMs fail grandly compared to reality on either a zonal or seasonal scale. That is why the AGW model-makers indulge themselves in the fiction that their GCMs will be reliable when predicting long range climate instead of short range climate–which is nothing more than a preconception–i.e., a simple-minded belief that has never been validated, nor can it be becasue the AGW null hypothesis has never been rejected nor can it be.

  67. Dr. Jay Cadbury, phd.

    This is probably a waste of time, considering Judy routinely ignores this question but I shall try once more. Given that the earth is below average temperature and below average co2 levels in the atmosphere, how can you attribute a warming of .8 kelvin to mankind? It just doesn’t make sense. It is very similar to Lucia claiming global warming is melting ice at the North Pole, without posting the temperatures. It is no wonder you 2 do most of your work behind the computer, there is a serious lack of critical thought.

    • ah your over here. the nurse was wondering where you had run off to. Time for your meds.

    • Jay, you need to unpack you argument for it to make sense, speaking of making sense. What average temperatures and CO2 levels are you referring to? One million years, one hundred million, or one billion?

      I do not buy AGW but it certainly makes sense as an hypothesis. If you accept that it has warmed over the last 30, or 50, or 100, or 150 years, and that the CO2 levels have risen over the same period then it is a straightforward hypothesis that the latter caused the former. It may not be true but it is scientifically sensible. In short this is a genuine scientific debate.

  68. Finally, OK, are daily TMax and TMin available for download? I have done that for a few places, specifically Canada. Summer TMax in Canada has been falling. In spite of all the hype from AGW faithful, summer heat wave days has been falling here. What has warmed, and is driving up the average, is winter temps have been getting milder. Maybe some of the AGW faithful here can explain how this is bad.

  69. Richard Saumarez

    ***** Message to Joshua *****
    Joshua.

    Could I make a suggestion? You make a long and detailed post outlining your position. Having done that we can all read it. Some of us may agree with you and others may not. That is the way of the world.

    After doing that could you then stop introducing flatulent and totally boring posts arguing whether people are deniers, sceptcs or true believers?

    If you were to do that , the quality of the discussion would rise immensely and be considerably more interesting.

    • **** Message to Richard ****

      Thanks for reading.

      There are some folks in these here parts that have a program you can download to enable you to easily discard the comments by specific people at this blog.

      If you don’t like my comments, then I suggest one of two approaches:

      (1) ask for the download – I don’t doubt that someone will provide it.
      (2) in lieu of that approach – don’t read my comments – or the myriad comments by those who (even though they may claim otherwise) think that my comments are interesting enough for them to respond.
      (3) endure the pain of reading my comments (honestly, I don’t force you to do so) and simply not respond.

      I would suggest to you those approaches, also, are the way of the world.

    • And Richard:

      I’ll point you to this comment that appeared immediately below mine in response to you:

      Just as bad, he continues to allow them to make the case that skeptics do not accept the warming trend over the last few hundred years, which of course is laughable.

      The questions I address WRT the beliefs about “skeptics” are relevant to a great number of the posts you might read at Climate Etc. – both in the sense that my posts discuss the reasoning they contain, and in the sense that even more specifically, many other posts contain opinions on the topic of the beliefs of “skeptics” and the beliefs of those on the other side of the climate debate.

      Perhaps you should take up your issues with them? If they didn’t write what they write, then I wouldn’t write what I write discussing what they write.

      Whew!

    • ***** Message to Richard *****
      ***** And to Richard Only *****
      ***** No, not you, Joshua! *****
      ***** Everybody else, stay away! *****
      ***** Pretty Please *****
      ***** with Some *****
      ***** Sugar on it *****

      http://www.greasespot.net/

    • You didn’t ask for my advice but I’ll give it anyway. Do not punch the tar baby!

  70. Has anyone mentioned Keenan’s post on Bishop Hill?

    http://www.bishop-hill.net/blog/2011/10/21/keenans-response-to-the-best-paper.html

  71. I have great respect for Anthony Watts, and put up a short post of appreciation on his blog this morning. But I don’t think I’m speaking out of both sides of my mouth when I say that I don’t believe he’s not being smart in this case. The NYT’s made him look foolish today in their short piece (I expect something much larger there soon as they see this as a great victory)…I actually cringed in sympathy for him.

    Of course the NYT’s is going to do everything they can to disparage skeptics, that’s not new. But in this case Mr. Watts is handing them the ammunition by giving the impression, or at least by giving them the chances to create the impression, of intellectual intransigence (otherwise known as denialism). Just as bad, he continues to allow them to make the case that skeptics do not accept the warming trend over the last few hundred years, which of course is laughable.

    He’s just one guy doing the best he can, and as I said on his blog I think one day he’ll be recognized as a hero in this fight to expose perhaps the greatest science fraud in history, but there are times when I think he would benefit from some expert PR advice. Of course such advice would probably have saved him from getting sucked into this mess in the first place.

    • “According to the UN’s Intergovernmental Panel on Climate Change, the greenhouse forcing from man made greenhouse gases is already about 86% of what one expects from a doubling of CO2 (with about half coming from methane, nitrous oxide, freons and ozone), and alarming predictions depend on models for which the sensitivity to a doubling for CO2 is greater than 2C which implies that we should already have seen much more warming than we have seen thus far, even if all the warming we have seen so far were due to man. This contradiction is rendered more acute by the fact that there has been no statistically significant net global warming for the last fourteen years.” ~Richard Lindzen

  72. Sorry, above should read : “I don’t believe he’s being smart.”

  73. Q1. Is BEST doing independent science regarding global warming by using GHCN data?
    A1. No!

    Q2. Does BEST prove attribution?
    A2. No!

  74. Where the data reflects an increase in the growth of atmospheric CO2 levels, we see decreases in global temperatures, as follows:

    “… since 1940 and from 1940 until 1980, even the surface record shows cooling. The argument is that there has been warming since then but, in fact, almost all of that is due to what is called the ‘urban heat island’ effect — that is, that the weather stations are around the edge of cities and the cities expanded out and distorted the record. When you look at rural stations — if you look at the Antarctic, for example – the South Pole shows cooling since 1957 and the satellite data which has been up since 1978 shows a slight cooling trend as well.” –Dr. Tim Ball (Nov. 2004)

    Let’s get real. Scientists in China, Japan, Russia — they’re all getting a good chuckle at the boy-yoy-yoing! science found in secular, socialist Western academia.

  75. Jim Cripwell raised the issue of the UHI distortion to the surface temperature record.

    The BEST UHI study group reported:
    http://www.berkeleyearth.org/Resources/Berkeley_Earth_UHI

    Time series of the Earth’s average land temperature are estimated using the Berkeley Earth methodology applied to the full dataset and the rural subset; the difference of these shows a slight negative slope over the period 1950 to 2010, with a slope of -0.19°C±
    0.19 / 100yr (95% confidence), opposite in sign to that expected if the urban heat island effect was adding anomalous warming to the record.

    But, as Judith stated, there is more work to be done on this topic.

    But let’s take a quick look at the data.

    Since January 1979, the GISS surface record shows a linear warming trend of +0.17°C per decade, while the UAH tropospheric record shows a warming rate of +0.14°C per decade over the same period.

    The troposphere is supposed to warm faster than the surface, according to GH theory, but the record shows that it appears to have warmed more slowly.

    The accuracy of the ocean record prior to around 2000 has been questioned (see Judith’s comment above).

    If one ignores these issues for simplification, one could postulate that the difference between the two records is due to distortions in the surface record, which can be attributed to the UHI effect, poor station coverage, loss of stations, etc. (all issues, which the satellite record does not have).

    This would represent +0.03°C per decade (a bit higher than the BEST estimate of +0.019°C per decade) or 0.3°C out of the 0.7°C warming reported over the 20th century.

    So even at only two-thirds this value, the UHI effect is not insignificant over a longer time period, as it represents 2/7 or 29% of the observed long-term warming.

    Max

    • PS Just see that BEST found that urbanization results in cooling instead of warming.

      Ouch!

      Let’s do some rework here, folks!

      • There are so many effects involved that one shouldn’t really be surprised on the nominal sign of the signal, which is anyway not statistically significant. The question is not, whether there are UHI effects, the issue is the net influence of all changes that have affected the time series. The presence of spurious effects in both direction has been known for years. Similar conclusions have been presented also previously (I cannot give references).

        Various tests give fair support to the conclusion that the changes that affect individual time series add up to a very small bias. There may be more systematic bias in the earliest data. It may be very difficult to estimate the size of such potential bias.

      • Pekka
        Would you agree that this is only a step in the overall process? The overall process could be described as:
        1st trying to get a better estimation of how much the earth is actually warming,
        2nd- then trying to model what that temperature increase will do relative to general atmospheric circulation (what the impact will be on precipitation in specific regions…GCMs or regional CM’s), and then:

        3rd- trying to determine what the impact the changes in temperature and rainfall will have upon humanity in the different regions.

      • steven mosher

        yes.

        For some time I’ve argued that the UHI bias, while large in some isolated cases, is actually rather smallish when you consider a wider range of circumstances. That small effect size makes categorization of rural and urban critical. If urban warms slightly more than rural, then your categorization better not have any cross contamination: a urban mis classified as a rural, will have a double whammy on your power. A rural classified as urban will likewise have a double whammy effect.. IF the effect is small. If the effect is large then miscategorization isnt that much of an issue

      • “For some time I’ve argued that the UHI bias, while large in some isolated cases, is actually rather smallish when you consider a wider range of circumstances. ”
        If it’s raining I doubt there is any UHI.
        Also it’s cloudy. I doubt it affects very much average temperature of Seattle or any place in Washington state.
        Also if it’s windy and/or it’s area that receives little sunlight- or most land areas on earth.
        UHI should most affect in Southern parts of US or during summer at higher latitudes.
        Though location temperature reading site and environment they in are different aspect issue than UHI. Having temperature reading near pavement or near an air conditioner exhaust will increase the temperature the “micro environment”.

      • Nebuchadnezzar

        The misclassification problem is relevant for all large-scale urbanisation studies I’ve seen. An alternative way of looking at it is to find the lowest and highest trending subset of the data while still maintaining a regular coverage and it looks like the BEST analysis can provide some measure of that. One can they say if urbanisation (or greenification) affects X% of stations then this is the largest that effect can be.

      • Pekka

        Gimme a break!

        Surely you are not going to try to rationalize that, despite the many studies that have shown the opposite in real-life examples, the BEST sub-group finding that URBANIZATION HAS CAUSED A SLIGHT COOLING EFFECT ON GLOBAL TEMPERATURES has any validity whatsoever – are you?

        Max

      • I very much doubt these “many studies that have shown the opposite in real-life examples” were looking at exactly the same thing as the BEST study was. And exactly matters at this small level of significance.

      • AK

        Are you trying to rationalize that urbanization has caused cooling?

        Please explain.

        Max

      • @manacker…

        Are you trying to rationalize that urbanization has caused cooling?

        First let’s be precise here: we’re not talking about cooling, we’re talking about slightly smaller levels of warming. If you want to subtract out the overall “global warming” trend for the total dataset, the remaining trend for the “very-rural” dataset is actually slightly warmer. This leads to a possible “cooling” Urban Heat Island effect.

        Now, one possibility is that urban areas aren’t as much warmer today than they were in the 1950’s, and there are many possible explanations for that. Alternatively, there are all sorts of other possible reasons for this effect. But note: in terms of “Global Warming” the UHI is and always has been an artifact of the measurement system. The claimed effect is thought to be caused by the effect of urban heat islands on thermometers, causing a false signal of “Global Warming”.

      • Max,

        that must be more of that Goreball Warming causes Goreball Cooling science!!!

      • That a spurious warming signal from UHI might be “statistically insignificant” is a point that could be debated.

        The comparison of the satellite and surface rate of warming indicates a difference of 0.03C per decade, and one could also say that this difference is “statistically insignificant”.

        But saying that urbanization causes cooling is downright nonsense, whether the number is “statistically insignificant” or not.

        That was my point, Pekka.

        Max

      • Max,

        since they have no statistically significant group of stations that are proveably unaffected by UHI the results are absolutely useless to determine the amount of UHI affecting the record. The theory used to be that Urban areas had UHI and Rural had little to none so the differencing was thought to have some usefulness. Dr. Spencer’s work and now this statistical video game show that we didn’t know much then and still don’t.

        Without serious baselining work where stations are set up to compare PRISTINE areas with Rural and Urban this is one more issue that makes the GMT pretty much useless no matter whose it is.

        I have a possible solution. Let’s remove a few large cities and rural developments and return the areas to pristine condition and see how the temps develop!! (I get to pick)

      • since they have no statistically significant group of stations that are proveably unaffected by UHI the results are absolutely useless to determine the amount of UHI affecting the record.

        It would be impossible to find any stations that would be proveably “unaffected by UHI.” Of course, you must realize that your statement undermines the “skeptical” argument that UHI distorts findings of trends in warming (which is rests on the distinction between “good” stations and “bad” stations). You’re asking to prove that any given line can’t be bisected.

      • Joshua,

        “You’re asking to prove that any given line can’t be bisected.”

        Uhh, don’t really know what to make of this response. I am saying that they HAVEN’T identifed amount of the various contributions to the warming or lack thereof or even cooling. As I posted elsewhere, we have several contributors to the possible warming of any station. As all of these can vary what would YOU do to show us how each item, Solar, GHG, UHI, Cloud… contributed to the warming or lack?

        Muller found that a subset of stations warmed at ~.2c/C faster than the other stations. This is an average of all stations so does NOT show the individual variance which is probably larger in some cases plus and minus. The problem is that none of us have no way of know how much of the actual signal for each station is UHI so this number is meaningless whether for the station set or for individual pairs. We do not know if one station is cloudier than another. We do not know if one station is windier or higher humidity or more precipitation or has frequent inversions…….

        I am beginning to wonder if this is a fault in the thinking process. Socialists think in terms of the collective and discount individual contribution!!

        HAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHA

  76. PeterB in Indianapolis

    Joshua,

    “If you don’t think the assessments that show warming are valid, how can you not question whether the world is warming?”

    Straw Man strikes again. It is PERFECTLY possible to assert the following:

    1. The temperature datasets (all of them) especially prior to 1979, are all suspect to one degree or another for several reasons (I can go into these if you like).

    2. The way the data have been manipulated and homogenized has been shown to be suspect in many cases, although BEST did its “best” to eliminate these homogenization “issues” and still shows a similar trend.

    3. There have been several instances in the past where the slope of the warming curve has been greater than or equal to the current slope of the warming curve, so the claim that the rate of warming is unprecedented and can only be explained by CO2 is spurious. For example the slope of the warming curve coming out of the Younger Dryas was remarkably more steep than the current warming curve in every study I have seen relating to that time period.

    4. In spite of 1,2 and 3, we were at the end of the Little Ice Age in 1850, and we clearly are not STILL in the Little Ice Age NOW, so obviously there has been warming.

    Any more questions?

    • Peter –

      4. In spite of 1,2 and 3, we were at the end of the Little Ice Age in 1850, and we clearly are not STILL in the Little Ice Age NOW, so obviously there has been warming.

      You are still going back to 1850. What happened over 50 years ago is largely irrelevant to evaluating the impact of CO2 emissions. We could STILL not be in an ice age, but not be warming. We could be not be an ice age and be cooling. We could not be in an ice age with there being no temperature trend. There is no reason to assume that “the world is warming” based on the trivial observation that we are not in an ice age.

      Once again – our illustrious host has said (paraphrasing) that she doesn’t know any “skeptics” that doubt that there is a warming trend over the past 50 years. Now maybe many “skeptics” do agree with that – but to agree with that would imply an opinion that the temperature record data is valid. To say that you believe that the world has been warming over the past 50 years, but at the same time to say that the data don’t validate such an opinion is internally inconsistent.

      Again – read David W.’s post above. It is internally consistent – and it also lies outside of the categorization that “skeptics” don’t doubt that the world is warming.

      • “Once again – our illustrious host has said (paraphrasing) that she doesn’t know any “skeptics” that doubt that there is a warming trend over the past 50 years.”

        Now you seem to understand. You specified the time scale. Fifty years, OK that’s 1960 -2010. Now, I don’t know anybody who doubts that there is a warming trend over that period. Of, course it depends on definition of warming (temperature or heat/energy), but ignoring that and talking strictly temperatures, I have never seen a post doubting that “global temperature” hasn’t increased over the last 50 years. What most sceptics are critical of is magnitude and causes.

      • Yes – she specified whereas Anthony didn’t. That doesn’t address whether his statement (that you agreed with) is accurate.

        But:

        Now, I don’t know anybody who doubts that there is a warming trend over that period.

        Really? You haven’t seen comments about “global cooling?” About “What warming?” That the “Warming has stopped?” That “There is no warming?” All those opinions would be based on the opinion that there is no valid trend of warming over the past 50 years. You can’t have a valid trend of warming over the past 50 years if the “warming has stopped.”

        And even if you haven’t (which I find hard to believe) – have you never read posts that doubt the validity of the methods that establish a trend of warming over the past 50 years? How can one agree that there is a trend of warming over the past 50 years if one feels that none of the methodology used to quantify the data are valid?

        I’ll refer you also to David W.’s post. At least it is internally consistent – although it lies outside Anthony’s characterization of “skeptics.”

      • Josh-ua,

        I have asked you a similar question before, with no reply: Why don’t you enumerate those skeptical commenters on this board, who have said that there has been no warming over the last 50 years?

  77. What Berkeley Earth has not done is make an independent assessment of how much of the observed warming is due to human actions, Richard Muller acknowledged.

    Let me do an “independent assessment of how much of the observed warming is due to human actions”

    1) We have learned that Berkely Earth’s global mean temperature anomaly data are similar to hadcrut3vgl and gistemp

    2) Oscillation in global mean temperature is due to thermohiline circulation cycles as described in the following paper:
    http://bit.ly/nfQr92

    3) There was a long-term global warming of 0.06 deg C per decade since temperature record begun in the 1850, one hundred years before the start of the exponential growth in human emission of CO2 in the 1950s, as shown in the following graph:
    http://bit.ly/pJhIaw

    4) As there was no change in the global warming rate of 0.06 deg C per decade since temperature record begun in the 1850s, the contribution of human actions on the observed warming is nil, naught, zilch.

    • steven mosher

      except girma now you gotta draw your lines back to 1800. have fun

      • steven

        I am dumbfounded with the IPCC’s failure to subtract the warming rate due to ocean cycles from the recent global warming rate of 0.16 deg C per decade for the period from 1970s to 2000s.

        Warming rate due to ocean cycles = Actual recent global warming rate – Long-term warming rate

        Warming rate due to ocean cycles = 0.16 – 0.06 = 0.1 deg C per decade.

      • vukcevic

        What is “North Atlantic SST precursor”?

        Why not add a caption for the graph?

      • get busy redrawing your lines. dont cherry pick the start date

      • steven

        I think girma’s figures (like HadCRUT3’s) going back to 1850 are good enough for some things.

        They simply show the observed multi-decadal cycles of warming and slight cooling, the last two of which were declared as “statistically indistinguishable” by Phi Jones.

        These represent a bit of a dilemma for those who firmly believe that CO2 has been the main climate “:control knob”, as there are no such cycles in the CO2 record. As a result, they require separate rationalizations that represent a departure from the Occam’s Razor principle.

        I know that it is not part of BEST’s brief to try to attribute a CO2 causation for the temperature record, but simply to establish if the surface record, itself, is meaningful at all.

        The preliminary BEST report has been informative, but I am looking forward to its final report – so far there isn’t much “meat on the bone” IMO.

        As our host here has put it:

        The papers are initial steps in analyzing the data set, and the verdict on these particular papers will be given by others who do subsequent analyses.

        Let’s see what these “subsequent analyses” tell us.

        Max

  78. It seems to me that there are some things in the Berkeley report that are very interesting.

    When I look at Fig. 1 in the report, available here:

    http://www.berkeleyearth.org/Resources/Berkeley_Earth_Decadal_Variations

    you will see that the 2010 temperature is considerably lower than in the other three records. In the El Nino year of 1998, three of the four records (including Berkeley) were at an anamoly of almost plus 1.0 degrees. At the end point, 2010, three of the records were between plus 0.85 and 0.95, but Berkeley was under 0.6. It is literally the last year where Berkeley breaks away, downward, from the pack. Could that possibly have to do with how Berkeley handled the dropping of so many surface stations? I’d look into that, ASAP.

    Eyeballing the change from the beginning of the satellite temperature era, 1979, it seems to me that Berkeley’s trends through 2010 are the closest in temperature trends to the satellite records, which have lower trends than the land based records (0.140 degrees per decade for UAH, 0.148 for RSS, through Jan. 2011:

    http://en.wikipedia.org/wiki/Satellite_temperature_measurements#Trends_from_the_record

    If I were you, I’d concentrate really hard on the Berkeley 2010 temperature, which goes strongly in the opposite direction than the other three records.

    The other thing that really stood out in the Berkeley work is that the land surface temperature record is much more closely related to the Atlantic Multidecadal Oscillation (AMO) than to ENSO. The PDO and AMO appear to be closely correlated, with PDO changes leading AMO changes by about 2.5 years (Fig. 5).

    We’ve all read the articles by “mainstream” researchers suggesting that temperature might not rise for a couple of decades because the PDO is in its declining 25 to 30 year cycle. If this is true, then the AMO may not be far behind, and if Berkeley is correct that the AMO and surface temperatures are tightly linked, then we may indeed not see much warming for a while.

  79. I’m wondering if anyone has looked at the actual data yet – and I don’t mean with a meat grinder. In BEST, ID #141457 is listed as ‘BUFFALO GREATER BUFFALO INT’L’. There are data from 1873 to 2010 in the file ‘data.txt’. First, there was no Buffalo Int’l Airport in 1873, so either the data are mislocated or they are a combination of separate stations. I thought eliminating these problems was a feature of BEST. Second, for 1873, the 12 monthly values for temperature are:
    12.782, 11.615, 12.295, 12.208, 11.568, 11.546, 11.403, 11.300, 10.938, 10.632, 7.576, 13.909
    Besides being unrealistically warm, it seems unreasonable that January and December would be the warmest months of the year in Buffalo. I hope someone can point me to where I am misinterpreting the data.

    • steven mosher

      bad conclusions. You can’t merely look at input data. you have to look at intermediate steps, also the quality flags, also the station combining.

      The station name is just the most recent name. So before the airport was located there it would be named differently. You’d have to look at station histories to get that.

      I havent followed the source all the way through and dont know if they dump intermediate files ( as GISS does) so that you can track what happens at various datasteps.

      • K Scott Denison

        Wonder Under what circumstances January and December have ever been the warmest months in Buffalo, NY?

      • Again, until you trace those values through the outlier detection and correction part of the code you dont have a clue whether that raw data made its way into the final result. hence the need for source code and intermediate data steps. I should not have to explain that.
        They took raw data in. They applied there own quality tests.

        Looking at the raw data tells you nothing we dont already know. raw data sucks

      • Looking at the raw data tells you nothing we dont already know. raw data sucks

        OK, Mosh … I’m not a climate scientist, and I strongly suspect that the only reason I got a passing grade in the stats 101 course I was obliged to take during the process of acquiring my Psych/English degree was that I was successful in using pre-post-modernist logic (and a tiny bit of good old-fashioned rhetoric).

        In the intervening years (which are more than I care to reveal!), I have acquired a number of proficiencies in working with data.

        As a big picture pattern picker-outer person, I’ve always found that working with/examining source (i.e. raw) data has enabled me to solve more problems than data which has been filtered and/or otherwise distanced from the source/raw data..

        So please tell me, why is climate-related raw data different from all other raw data? Or should I, uh, pass over this question?!

      • So you have not actually looked at the data – thanks.

        BEST has since replaced ‘data.txt’ with a new version. The new version has Tavg for Buffalo back to 1831, which matches GHCN, but the temperatures are still screwy values. What a disaster.

  80. After reading the post, the comments to date, and the Wickham et al preprint on the UHI effect, here are some tentative impressions on a subject I haven’t studied in detail. They are based on my previous understanding aided by the Wickham paper and some insightful comments in the thread.

    The paper finds a “slight” negative slope – 0.19 C/100 years – in comparing the warming of all stations with those judged “very rural”, suggesting what one might call a “reverse UHI” that differs from previous estimates, most of which have suggested a positive but usually very small effect. The cause of the discrepancy is unknown. It may be artefactual, but adds to evidence that tends to exclude a climatically important UHI effect that exaggerates warming trends.

    It is not clear to me why there should be a significant trend in either direction a priori. There is no question that urbanized areas tend to be warmer than rural ones but that does not inevitably require them to warm significantly faster over the long term on a global average, and so the latter is a question that must be settled empirically. The new analysis adds to that evidence.

    A UHI effect must be distinguished from inappropriate siting of instruments – e.g., next to an air-conditioning vent that might blow warm air onto the measuring devices. The UHI effect refers to the real – not spurious – finding that urban areas tend to be warmer than the rural surroundings due to changes in albedo, reduced heat loss because of the obstruction from buildings, reduced evapotranspiration, etc. In general, these phenomena require fairly substantial urban buildup – a few buildings and a roadway should have very little effect. For those areas that are clearly urban, I’m not sure we know enough about the UHI phenomenon to predict how the growth of big cities into even bigger ones will affect their warming rates – in some cases, the rates might increase while other cities might show a reduction due to urban planning that creates more open areas.

    Legitimate questions are raised about misclassification of “very rural” stations. We might therefore ask how much misclassification would be required to convert the rural vs total station difference to zero, how much to reverse it, and how much to reverse it sufficiently to create an important positive effect. This would be worth modeling to some extent, but I’m inclined to believe that misclassification sufficient to miss an important positive effect is very unlikely. Perhaps that can be tested. At this point, the new information, in concert with existing data, fails to support a UHI effect as a source of significant distortion in the interpretation of global warming over land.

    • There is no question that urbanized areas tend to be warmer than rural ones but that does not inevitably require them to warm significantly faster over the long term on a global average, and so the latter is a question that must be settled empirically.

      AFAIK the cause of the hypothesized spurious warming is the expansion of urban area to include stations that previously were rural.

      A UHI effect must be distinguished from inappropriate siting of instruments – e.g., next to an air-conditioning vent that might blow warm air onto the measuring devices.

      Hear Hear!

      For those areas that are clearly urban, I’m not sure we know enough about the UHI phenomenon to predict how the growth of big cities into even bigger ones will affect their warming rates – in some cases, the rates might increase while other cities might show a reduction due to urban planning that creates more open areas.

      Not just urban planning. AFAIK most models of UHI are a sort of “bubble” of warm air over the urban area. However, if such a “bubble” gets big enough, convection will set in, producing something like a mushroom. On some days, that mushroom might actually act to draw surrounding air in, cooling all but the most central stations.

      We might therefore ask how much misclassification would be required to convert the rural vs total station difference to zero, how much to reverse it, and how much to reverse it sufficiently to create an important positive effect. This would be worth modeling to some extent, but I’m inclined to believe that misclassification sufficient to miss an important positive effect is very unlikely. Perhaps that can be tested.

      A good idea.

    • my comment below, thx

    • Josh-ua,

      Why don’t you emulate Fred. His droning defense of the dogma is at least based on somewhat plausible, although arguable, interpretations of the alleged climate science consensus. And Fred seems to be a decent and honest guy, who is just misguided. He is clearly not here only to be an antagonist. In other words Josh, you could be tedious in a much nicer way.

    • Fred, I mostly agree. The only thing I would change is rural vs. urban. Rural stations can have high UHI growths, higher than urban and therefore higher trends. The proper distinction should be unchanged vs. changed (or wild/built or similar). So, absolutely best stations please (few hundreds is enough) and it doesn’t even have to be 100 years or more. The last 50 years would be something. Let’s see what 200 unchanged stations show over the last 50 years (or more if available).

    • Fred

      There are scores of studies out there, which clearly show, based on individual locations all over the world, that urbanization has caused warming at a local level.

      Therefore, a preliminary conclusion, which shows that the impact of urbanization on the global temperature record has been one of slight cooling is not logical. Whether or not it should be discarded a priori as an error, is another point.

      But is surely does not make any sense, so should not be used as a rationalization that the UHI impact is negligible, as you are apparently doing.

      Max

  81. “There is no question that urbanized areas tend to be warmer than rural ones but that does not inevitably require them to warm significantly faster over the long term on a global average, and so the latter is a question that must be settled empirically.”

    Isn’t there also no question that as time goes on and more places became urbanized? And so the temperature should go up. The point would be that warming is still due to man but not co2. Or do I misunderstand you?

    There could also be an affect of wilderness to agricultural or other vegetation changes. Even a distinction and change in urban residential, versus urban industrial or commercial, high density versus low density. I think this is the areas of interest of r peilke sr.

    • That was in reponse to fred above

    • I think the point is whether urban areas warm faster than non-urban areas.

      In terms of evaluating trends, you can still find a valid trend of warming if both types of areas warm at a similar rate. You are determining trend by comparing the stats from the same locations over a period of time. You are not determining trends by simply by overall warming – in which case a warming trend might be only an artifact of urbanization.

      Or do I misunderstand you?

    • Isn’t there also no question that as time goes on and more places became urbanized? And so the temperature should go up.

      Kermit – In response to you and relevant to points made by AK above, the assertion that a UHI effect is a distorting influence on temperature interpretation, as I understand it, involves the fact that urban stations are greatly over-represented in temperature records and so the effect of their temperature change on global temperature is over-represented. Urban areas in the record represent a very small percentage of the actual land area of the globe. The claim is not that because cities are growing, the heat they exude is making the world warmer (urban heat is probably insufficient to do much of that, although Pat Michaels did imply otherwise), but rather that they are making it appear warmer than it is. As long as locations are classified correctly in both current and past records, it should be possible to ascertain whether urban locations are warming faster than rural ones. If they are not, then changes in global land temperature can probably not be attributed to urban heat to any large extent. Whether there is any significant contribution is a topic that will probably continued to be argued.

      The two concepts to be distinguished are (a) cities are expanding and making the world warmer. and (b) cities are warming faster than rural areas and that causes the record to show more warming than is actually occurring. It is item (b) that is the “UHI effect”.

      • There are some other concepts or subconcepts that you touch on and others I think could be important.

        – cities are expanding and (maybe) are making the world only appear warmer.
        – cities are where people live so measurements may be more accurate, and/or maybe more important to us. I assume data is easier to get from urban areas and at earlier periods in cities, perhaps science stations also. Here is why I say this, only land areas were used in this study. I assume it was for these same reasons, people live on land and so it is both easier to get, and more relevant because that is where we live. Take Greenland, in the video by BEST they have data points back to 1850 yet I would assume that data would be more extensive in the UK at that time. Yet the video shows it of equal value. It’s likely that the UK data is even more accurate, even though the temperature in Greenland is probably of more life-and-death value.

        There are many other considerations, climate (on a tropical island there is less variation then an arctic one), cultural (in the 19th century UK they had a culture that put importance on measurement), purpose of the measurement (for science or for navigation or for agriculture), time period, methods. Perhaps these all even out in the end.

        So to me this means that some data should be weighted accordingly, maybe they do, but then someone has to judge what is the weight, then the analysis becomes subjective to become of value. There is where bias comes in. These are the tricks referred to in ClimateGate. If you take your car into your mechanic and he says there is nothing wrong with your car you don’t pay him. The mechanic will try very hard to find a problem with your car.

        IMO

      • Fred Moolten:
        I disagree with the whole concept of urban versus rural when one is trying to judge the accuracy of a global temperature record. The classification of rural has nothing to do with construction that can effect rural records.

        But let’s look at what can happen. If you put a thermometer in a city that is already built up you may get very little additional build in the immediate area of the thermometer. But the city will continue to grow at the edges, and to a much smaller extent in already built areas. This will certainly give an increasing UHI effect for the thermometer.

        Now let’s consider the rural areas. Notice that virtually the entire east coast and west coast of the US are dotted solid with black dots indicating that there are thermometers there that are considered rural. These areas are densly populated and getting more so all the time. So a designation of rural should not make one think of a cow pasture in the country side. Rural can still mean significant build and it can still mean that significant building is happening. In fact, the availability of open land means that construction could happen very close to the place where the thermometer is placed, without any change in the thermometers status. This construction close to the thermometer would have a more direct effect that construction in a city that is happening at the edges, far from the thermometer. So putting a city of, say, 20,000 around a thermometer will still leave that as a rural thermometer, but the effect on the thermometer can be greater than what is happening in a city where the thermometer is in an area that is built and not changing much.

        In any case, the question that BEST asked, which is “how do areas that are classified as rural compare with areas that are classified as urban”, completely fails to answer the question, “how has construction of roads, parking lots, buildings, etc. effected temperature trends”. In fact, the answer that they have produced is simply stupid. I can’t believe that they accepted it without having it occur to them that they may have done something wrong. It seems like we should be able to get some indication of what is happening to global temperature trends that are uneffected by UHI by looking at SSTs.

  82. Douglas Keenan was a reviewer of four of the BEST papers. He has made his review comments available at Bishop Hill, http://www.bishop-hill.net/blog/2011/10/21/keenans-response-to-the-best-paper.html

    They are worth reading.

  83. Thanks for a very interesting post and for a link to the Economist article on the BEST project. As much as I like the Economist (subscriber for more than 15 years) I find its reporting on climate issues to be irritating for a newspaper that believes in economic rationalism and free enterprise. And this this article misses the mark entirely with its silly, triumphalist spin. The main question remains whether an upward trend in temperatures observed for the last century or so is part of a low-frequency cycle that is a component of its “normal” stochastic behavior or if it signals an aberation due to human activity. An improved 150-year series of temperatures cannot answer this question or reduce valid skepticism about the methods used to backcast prior temperatures using proxy variables. Having better data, though, is always a welcome thing and makes for better science.

  84. The UAH satellite record show substantial cooling from the endo of 2009 through the end of 2010, of roughly 6/10ths of a degree:

    http://img856.imageshack.us/img856/2403/dailyuahtempsmar92010.png

    This big drop in in agreement with an even larger drop found by the Berkeley group, but opposite in sign and magnitude to the three other land based records (NOAA, NASA-GISS, HadCRU). See Fig. 1 — zoom in — in the Berkeley report:

    http://www.berkeleyearth.org/Resources/Berkeley_Earth_Decadal_Variations

    This divergence between Berkeley and the other three records might be very important. Suppose that Berkeley has found an anomaly that has escaped the other three “official” records. In theory, that would be the type of thing that Berkeley set out to do. If this 2010 temperature finding is correct, then the last year of the series is between 0.15 and 0.2 degrees lower than the other three, “official” series. That would mean that the trend for the Berkeley series is about 15% to 20% lower than for the other three.
    So it seems to me that we have to understand why the Berkeley 2010 temperature figure is so much lower than the other three land records, but in agreement with UAH.

    • The graph shows 12-month moving averages with the final data point appearing to show the average of July 2009 to June 2010, so in any case it doesn’t show a comparison of 2010 anomalies.

      The most likely reason for the discrepancy is that BEST don’t have 2010 data finalised yet so in their comparison setup January to June 2010 monthly anomalies are set to zero, creating a downward diagonal in the moving average.

      Also, the 2010 anomaly in UAH is in good agreement with the surface records.

  85. “Our biggest surprise was that the new results agreed so closely with the warming values published previously by other teams in the US and the UK,” said Prof Muller.

    Now that it has been adequately confirmed that the analysis of global temperature data by NOAA, GISS, and HadCRU (showing that the global temperature has been increasing by 0.2 °C per decades since 1970) has been correct after all, perhaps Prof Muller and associates will now also take a look and verify that the radiative forcing due to the increase in greenhouse gases has indeed been responsible for this observed increase in the global surface temperature.

    • K Scott Denison

      Perhaps one should answer the concerns from Doug Keenan before assuming the BEST data and analysis are correct.

      Also, when do we anticipate that an appropriate and accurate description of the results will be released.

      As I read what BEST has done, it is to:

      – analyze data from a large number of stations that still represent a very small percentage of the land mass of the globe, which in itself represents only 30% of the total area of the globe.

      – average the Tmin and Tmax, which most certainly does not represent the average temeperature for a day, which would be the integral over 24 hours of all temperature function at that station for that day.

      – no addressed whether the temperature variations seen are statistically significant or just random variations in climate.

      So at best (pun intended) they’ve shown that some temperature metric at a small fraction of the globe’s surface is now higher than it was at some time ago, but we don’t know if that is due to random variations or as part of a warming trend, and if part of a trend, we don’t know the causation of that trend.

      Now that’s not much we can say after half a million and a lot of work!

      How one gets from this to the headline in a press release about non-peer reviewed papers is, in a nutshell as they say, the problem that many skeptics (including me) have with climate “science”!

      IMHO, the climate “scientists” have shot themselves in the foot yet again.

    • Now that there is agreement with observations ,this tells us that the physics are indeed wrong ie the Krakatoa problem eg Stenchnikov 2006

      The observed value no doubt has substantial temporal sampling errors, and the observations for the earliest eruptions considered may suffer from inadequate geographical sampling or other data quality issues. It
      is noteworthy in this respect that the global-mean surface temperature record used in this study surprisingly shows no global cooling following the very large 1883 Krakatau eruption [Jones et al., 2003]. However, the surface air temperature reconstructed by Hansen and Lebedeff [1988]
      shows a more sizable cooling effect of Krakatau, which indicates the level of uncertainty in the observations themselves, especially for earlier volcanic events

    • Steven Mosher

      The interesting thing will be seeing how and if reconstructions change.
      You have reconstructions that are calibrated to HADCRU back to 1850.
      Looking at the differences between HADCRU and BEST you’ll see that HADCRU lies outside the boundaries of BESTs CI.

      The HADCRU methodology results in using a much smaller number of stations to estimate the mean. This is especially important in early years where you have records which stop before the HADCRU common anomaly period.

      I think the next course of action would be to see how this better more statistically sound series changes the envelop of reconstructions. Since, as Hansen argues, Paleo gives us the best look at the ECR it would seem that the next course of action would be to recompile reconstruction results using the best temperature series. If everything turns out the same, all the better.
      Thats another brick in the wall.

      So, given the talents in Mullers group and given the importance of the instrumented record to reconstructions and given the importance of recons to ECR.. the logical thing for them to do is to have a look at recons.

      • Mosher: “So, given the talents in Mullers group”

        What talent? They decided that there is no UHI effect. You can hardly get dumber than that.

      • Steven Mosher

        If you think that there is hude UHI effect you are welcomed to do the following

        1. Download their data
        2. Download their code
        3. Define your own criteria for urban and rural
        4. Prove that the trends in urban are substantially greater.

        This problem is not easy. I suspect you won’t do a lick of work

      • Mosher: “You have reconstructions that are calibrated to HADCRU back to 1850.
        Looking at the differences between HADCRU and BEST you’ll see that HADCRU lies outside the boundaries of BESTs CI.”

        LOL. If you are talking about proxy reconstructions, they can’t even find proxies that warm as much as HadCrut. How much more cherry picking are they going to try to do to match BEST?

    • Nothing has been confirmed. First of all, they diverge from HadCrut. Second of all, they have concluded that there is no UHI effect using a methodology that is incapable of drawing such a conclusion. A brain dead conclusion if there ever was one. Third of all, their source data sets are drawn from the same place as the previous sets and are subject to the same potential problems. Fourth of all, they still diverge from the satellite records. Fifth of all, they still outrun the proxy data, just like all the other sets.

    • Dr. Lacis
      In the paper
      Decadal Variations in the Global Atmospheric Land Temperatures
      It is also said:
      “On the other hand, some of the long-term change in the AMO could be driven by natural variability, e.g. fluctuations in thermohaline flow.”
      I happen to be reasonably familiar with the AMO (or the N. Atlantic SST) and the most climate related events (both causes and consequences) in the North Atlantic.
      I have identified process which is advanced to the AMO and the NAO by some years, which may or may not be at the root of the SST’s upward trend.
      http://www.vukcevic.talktalk.net/NA-SST.htm
      In my view it is not possible to determine degree of the CO2 contribution to any degree of certainty until all possible natural causes are eliminated.
      We should not be guided by our beliefs, but with our knowledge, and as far as the AMO is concerned our knowledge is far from complete or even adequate to be able to make scientifically valid judgment about its contribution to the global temperature rise or fall.

      • What is an SST precursor?

      • I am currently putting together short article, so all necessary information will be there. Data I use are from NOAA, NCAR etc.

      • Sure thing. We should not be relying on beliefs when we have real knowledge of facts and physics to go on. We must of course keep in mind that the best that our current ocean models can do, is to generate natural variability in ocean response that has some resemblance to the El Nino, La Nina variability. I am not aware that the current ocean models can do anything reasonable with respect to modeling AMO climate variability.

        Accordingly, the best that we can do with El Nino, La Nina, AMO, and PDO variability is to try identifying their spatial and temporal patterns in their early stages so that their short term climate impacts can to some extent be extrapolated into the future.

        As for the climate impacts of CO2 and the other greenhouse gases, we have the advantage that here we have facts and physics to bring to bear. The time trends for the GHGs are being accurately monitored. We also have available accurate HITRAN absorption coefficients for all the relevant GHGs. And we have available reliable radiative transfer models to calculate the radiative forcings due to these GHG increases, and reliable models to calculate the climate impact of these radiative forcings including the time delay of the climate system due to the large ocean heat capacity.

      • We should not be relying on beliefs when we have real knowledge of facts and physics to go on.
        I disagree, it is all in the data, physics of it is basic, far simpler than one may suspect.

      • Correction: It should be ‘I agree’.

    • Hello Andy, I have a question that you can probably answer for me. I look at Figure 2 in the decadal paper and I see the AMO index. It looks to me like there is no upward trend. Has this data been detrended?

      Thanks,

      • David,

        I don’t see any reason why they would try to ‘de-trend’ the AMO index. Moreover, to first order, I would not expect there to be any long-term trend in the AMO index. I tend to think that the AMO and PDO, and the shorter period El Nino and La Nina variability represent natural (unforced) fluctuations and oscillations that the climate system undergoes about a zero reference point – hence, no long-term trend.

        It is possible that global warming might induce some change in the amplitude, frequency, or pattern of these unforced fluctuations, but I have seen no evidence that that might be happening.

      • A Lacis

        I tend to think that the AMO and PDO, and the shorter period El Nino and La Nina variability represent natural (unforced) fluctuations and oscillations that the climate system undergoes about a zero reference point – hence, no long-term trend.

        “fluctuations and oscillations”=> http://bit.ly/p1VPcC

        “long-term trend” => http://bit.ly/pJhIaw
        (a warming rate of only 0.06 deg C per decade, not IPCC’s 0.16 deg C per decade; therefore, true climate sensitivity = 3 *0.06/0.16 = 1.1 deg C)

      • The AMO is treated as some kind of taboo by the climate scientists. The AMO is simply N.A. SST with the trend taken out, so AMO by definition is the DETRENDED N.A. sea surface temperature.
        Many suspected that this oscillation may be do with TSI, with some solar papers (Reading University) trying to establish the link. I do not think that to be the case, the change (according to my findings, which will be fiercely disputed) is directly related to the events in the Arctic Circle.

      • It is wrong to assume that the AMO (or the SST) has a regular cycle, as it is often suggested.

    • A Lacis

      Now that it has been adequately confirmed that the analysis of global temperature data by NOAA, GISS, and HadCRU (showing that the global temperature has been increasing by 0.2 °C per decades since 1970) has been correct after all, perhaps Prof Muller and associates will now also take a look and verify that the radiative forcing due to the increase in greenhouse gases has indeed been responsible for this observed increase in the global surface temperature.

      What caused the earlier similar warming both in magnitude and duration from 1910 to 1940, when human emission of CO2 was 1/5th of that during the recent warming period, shown below?

      http://bit.ly/bx3Ebh

      The recent warming is identical to the previous one, and it is not unprecedented. By Ockham’s razor principle you assume it is natural.

      In addition, the globe has started its cooling phase as shown in the following data.

      http://bit.ly/nz6PFx

      AGW is not supported by the data!

  86. steven mosher

    Wow,

    Leslie Kaufman at the NYT really butchered by comments. I specifically told her that my issue on this wasnt transparency. specifically told her that I thought the results were as expected.

    Then again, she thought I was steve mcintyre till I corrected her.

    maybe I should post our email exchange? it’s hilarious..

    Votes?

  87. I would ask her/him permission and give her a chance to defend herself.

  88. Figure 1 in the Berkeley Earth Decadal Variations shows intervals where the BEST temperature series departs dramatically from all 3 of the other series: 1954, 1956, 1968, 1993, 2010 (years approximate.) Have the authors addressed such seemingly bizarre discrepancies? I can imagine explanations, but have the authors explicated some of these?

  89. UHI and erroneous ‘averaging of data’ actually hid a cooling trend taking place in France since 1871. The land-based thermometers were located at airports were snow is always immediately cleared, resulting in the recording of anomalously higher winter temperatures compared to the surrounding countryside.

    Added to that are other factors. For example, airports get hotter in the summer and many use de-icing sprays or burn tons of kerosene to keep August and Christmas flights humming.

    These average-skewing UHI effects actually masked a decline that everyone really knew had actually occurred because reality even overwhelmed the erroneous data collection methods and termperatures still dropped.

    What we learn from the lesson of France is that we are not dealing with an ‘average temperature’ — what we really have is an ‘AVERAGE OF TEMPERATURES.’ And, worse yet – in France – we’ve got erroneously structured data and results obtained from areas of airport tarmac instead of French countryside.

  90. I suspect this is a naive question but why is BEST comparing the set of “very rural” to the set of “all stations including very rural”?

    I would have thought that the proper comparison would be “very rural” to “all stations without very rural”. Comparing something to itself seems odd.

    • Hi Jay – I think the distinction may not be very important because we could calculate one from the other. To my mind, the method used by BEST offers an advantage in that it’s easier to visualize what the results mean. The overall average temperature trend is something whose meaning we can visualize, and so is the trend of very rural stations. On the other hand, what to make of “non-very rural” stations doesn’t lend itself to easy interpretation because they are so heterogeneous. If the two concepts were not intercovertible, I would think it might be wise to present both datasets, but as it is, there is probably no need..

      • Fred,

        you are just bloviating now. Comparing a set of stations against a set of stations that INCLUDES that set of stations REDUCES any possible differences.

  91. So we’re all, or nearly all, in agreement now that the temperature record is reliable, are we? Not that anyone has ever said otherwise of course!

    http://www.skepticalscience.com/surface-temperature-measurements-advanced.htm
    http://www.skepticalscience.com/the-best-kind-of-skepticism.html

    • HAHAHAHAHAHAHAHAHAHAHAHAHA

    • Independent verification is always nice. How much discussion was there on V&V procedures on this site in the past, and now it is marginalized by all sorts of excuses. What many people do not seem to understand is that verification is also the process of gaining confidence in the models and results.

  92. Its a semi-effect PR stunt, while their not in competition with any one else so had no need to rush it out ‘to beat’ someone , the need to rush it out was political one hence all the effort gone into the press and marketing which lets remembers has nothing to do and does not add to the science .
    And why semi-effect, while although they know that should these papers fall to bits in peer review this will not make the headlines, as by they this will be ‘old news’ Its not actual getting the coverage or impact it was designed to . I would take a good bet Bob Ward and his fellow AGW spinners are spitting feathers over what happened to Gaddafi and the way its dominating the headlines. While given the economic situation people attentions are rather fixed on bigger concerns and I cannot see the return of the amount of political will needed to ensure a return of the ‘good times ‘ for the Team the and friends on the back of BEST work .

  93. Maybe a good way to get some feeling for the effects of UHI is to compare land based trends to SST trends. We know that there is no UHI effect to the SST trends. Here is a NOAA chart.
    http://processtrends.com/images/RClimate_SST_A_latest.png

    Looks like about 0.5 C since 1880. I’m not sure that it’s a fair comparison due to ocean circulation. But the current SST trend looks to be flat (last dozen years). And I can’t see how it could be flat if global temperatures are, in fact, rising.

    • Don’t worry the SST will catch up to the land trend, as soon as that heat hiding down in the depths resurfaces. I used to think there was a lot of cold hiding down there, but now I know better.

    • Actually, the land temperatures have been going down for the last 10 years, more so in BEST than in the other datasets.

      • Hmm. I must have had my head tilted when I looked at their chart.

      • Sorry, They are going down in the BEST and are nearly flat in the others.

      • David:
        Just to make sure we are not talking past each other. I’m looking at this chart. Are you looking at the same thing? I know that it’s a compressed scale for looking at the recent trend. And it’s kind of burried with the others. But I don’t see a decline. Maybe you have a more isolated chart that only covers the last dozen years or so and that has a trend line.

        http://www.berkeleyearth.org/analysis.php

      • Yes, I’m looking at Figure 1 in the Decadal paper. It shows more detail in the last 15 years. If you look very hard you will see that in 2010 Best goes down quite a bit and is about 0.1 C lower than in 1998.

      • Brandon Shollenberger

        David Young, it’s important to remember Figure 1 in that paper was made by using data from only 2,000 stations. It will be different than what is gotten when all stations are used.

      • Brandon, I see your point. Thanks

      • Brandon Shollenberger

        Not a problem David Young. I was confused about the same thing. It’s especially confusing because none of the four papers actually publish the BEST temperature record, so it’s not like you’d see the “right” graph in addition to that one.

        For what it’s worth, you can find the record posted on their site, here.

    • You know, in the time it took you to make all these grumpy comments, I’m pretty sure you could have answered your own questions three times over. As in, getting some station data from some locations *near*, but not *in* urban centers (the kind that were pretty much rural in the early 20th century, but are suburban or fully urban by now), and see what happens over the 20th century as urbanization extends.
      .
      Then you could actually try to estimate just how much of the global land surface is composed of such areas, which might give you an idea of how much you should weigh the resulting value to estimate its actual effect on global land temps. Looking out the window next time you take a plane might provide some interesting clues.
      .
      If you find a huge number, you can book your trip to Stockholm! (And when you get there, be sure to tell them about your theory that UHI effects can be estimated by looking at the difference between land and sea warming rates. I’m sure they’ll be quite impressed :) )

      • toto: “Then you could actually try to estimate just how much of the global land surface is composed of such areas, which might give you an idea of how much you should weigh the resulting value to estimate its actual effect on global land temps.”

        It’s not about how much land is urban and how much is rural. It’s about where the thermometers are. You won’t find many of them in national parks or on farms. In other words, the distribution of the thermometers doesn’t come close to represtenting the percentage of true rural area versus the percentage of built area.

        “(And when you get there, be sure to tell them about your theory that UHI effects can be estimated by looking at the difference between land and sea warming rates. I’m sure they’ll be quite impressed ”

        Not as impressed as by your theory that SSTs can be going down while land based temps are going up.

  94. No I’m not making this up. Anthony Watts really did say:

    “And, I’m prepared to accept whatever result they [the BEST group] produce, even if it proves my premise wrong. I’m taking this bold step because the method has promise………… but the method isn’t the madness that we’ve seen from NOAA, NCDC, GISS, and CRU, and, there aren’t any monetary strings attached to the result that I can tell.

    http://wattsupwiththat.com/2011/03/06/briggs-on-berkeleys-best-plus-my-thoughts-from-my-visit-there/

    • Guess that Anthony, in his wildest dreams, never anticipated that this group would be so stupid as to declare that there was no UHI.

    • I’ll have to take a look at what the BEST group have said about the UHI effect in more detail but its my understanding that groups like GISS have never claimed that it didn’t exist and they have corrected their data for this effect as described by James Hansen.
      http://pubs.giss.nasa.gov/docs/2001/2001_Hansen_etal.pdf

      Maybe Judith could clarify if the BEST group disagree with Hansen on this? If they do, it can’t be by much. The BEST and GISS results are very close.

      • It doesn’t really matter about the comparisons between BEST and GISS regarding UHI. The simple matter is that the BEST UHI test does not come close to testing what they claim to be testing.

      • So you say. The BEST papers aren’t yet peer reviewed and the idea of making them publicly available at this stage is to give everyone an opportunity to correct any faults. There can be no charges of “Pal review”.

        So we’ll have to see what objections are made and whether they are valid.

        Reading between the lines, Judith doesn’t sound too happy about the section on the UHI. However, she’s the one with her name on the four papers. It’s a bit lame to say she is second author for alphabetical reasons only. It doesn’t matter if she’s first or last, she has to agree with their contents or ask for her name to be removed completely.

    • What exactly is ‘the premise’ referring to in that quotation? I can’t see from that webpage what Watts means. It can’t be that no warming is to be found, or that poorly sited stations exaggerate warming, since he has a paper out claiming the opposite: http://wattsupwiththat.com/2011/05/11/the-long-awaited-surfacestations-paper/.

      • I take Watts’ premise to be that the surface temperature record, (GISS , Hadcrut etc) is/was unreliable. Now BEST has come up with a very close match. So it will be interesting see if Anthony Watts will be as good as his word and “accept” the BEST findings. I doubt it somehow.

      • Temp,

        statistics cannot fix bad input and insufficient coverage. Poorly posed adjustments only add to the issue the same as the original. Mistakes like adjusting the recent temp up after a step decrease to homogenize the series must be researched to determine if it is appropriate, not simply applied because it MIGHT be the right thing to do. Could be the series was biased HOT before the step decrease and the older temps should have been adjusted DOWN!! Video Game studies simply cannot add certainty to the mess we have.

  95. Steve McIntyre

    Here is the first one, Lon Lat
    110673 NORILSK 69.333, 88.125
    According to Modis there are no built pixels within 5 minutes .0833 degrees
    But go to google earth and have a look. about 12% of the surface is impervious, 3% of the land is urban according to other measures of urbanity

    Nor’ilsk is either the largest or 2nd largest nickel smelting operation in the world.

    • While NORILSK is still not hightly developed, the actual build change that happened there over the last 100 years could be greater than the change experienced by an urban thermometer that was already surrounded by build when it was put there.

    • Now that would be ironic.

      If Muller was to be targeted for a smear campaign directed against his work.

      Then the circle will be complete.

      Should be easy. There’s a lot of data files and I am sure a few stations have been labeled wrong.

    • Steven Mosher

      Looks like there are a few urban pixels just at the outskirts of the .1 deg boundary, so they would classify this as urban and not very rural..
      .08333 versus .1C. took a bunch of compute time. arrg

  96. An interesting set of papers by BEST which reconfirms the other land surface temperature time series. I would like to comment on the UHI paper as I am surprised with the methodology they used.

    Roy Spencer did some work on UHI early last year. He used NOAA’s International Surface Hourly (ISH) weather data from around the world during 2000 plus 1 km gridded global population density data.
    http://www.drroyspencer.com/2010/03/the-global-average-urban-heat-island-effect-in-2000-estimated-from-station-temperatures-and-population-density-data/

    His abstract:
    “Global hourly surface temperature observations and 1 km resolution population density data for the year 2000 are used together to quantify the average urban heat island (UHI) effect. While the rate of warming with population increase is the greatest at the lowest population densities, some warming continues with population increases even for densely populated cities. Statistics like those presented here could be used to correct the surface temperature record for spurious warming caused by the UHI effect, providing better estimates of temperature trends”.

    See the graphs of “station warm bias” versus “pop density”.
    Other interesting analyses follow; scroll forward.

    I suspect all BEST have done is pick out a low population density subset of stations which have a higher rate of warming over the time period than the total population and viola, these stations report a higher warming rate than the total population. I’m not surprised they got the results they did.

    • I suspect all BEST have done is pick out a low population density subset of stations which have a higher rate of warming over the time period than the total population and viola, these stations report a higher warming rate than the total population. I’m not surprised they got the results they did.

      Geoff – Roy Spencer often describes his data in ambiguous fashion, particularly when the data are unpublished. In this case, he refers to greater “warming” in low population density areas than higher density areas, but from the description, he is not actually referring to “warming” (temperature increase with time), but to a one-yer averaged temperature as a function of population density – 1000 more people in a very sparsely populated region is associated with a greater temperature difference than an extra thousand in a more populous area. I’m not sure this would be particularly relevant to the BEST analysis unless it turns out first that the correlation reflects causation (population growth causes the temperature to rise) – something that is not implausible – and second that there has been a far greater percentage population increase in the BEST “very rural” areas than in more populous areas – a possibility that would need to be very consistent to result in the magnitude of the effect in the Wickham paper, and which seems somewhat doubtful.

      Others can check the Spencer blog to see if they think he was saying something else.

      • Fred:

        Since you link your page I went and listened to three of your songs on YouTube. They were folk and eco-preachy. Got anything more jazz or blues oriented and less eco?

      • On my web page, listen to Midnight Fugue and Waiting for the Midnight Blues.

      • Okay, that’s more like it. I liked them both. But I didn’t like the soliloquy in Midnight Fugue. Lisa and Maria can both sing. Lisa has that special touch.

      • Fred to me there is nothing ambiguous in Roy Spencer’s post; maybe it is a little difficult to understand at first. He makes the point: –
        “Some readers were left confused since my posting was necessarily greatly simplified; the level of detail for a journal submission would increase by about a factor of ten”.

        Hopefully, as suggested in a following post, a paper will be published: –
        “John Christy has agreed to co-author a paper on this new technique, since he has some experience publishing in this area of research (UHI & land use change effects on thermometer data) than me. We have not yet decided what journal to submit to”.
        http://www.drroyspencer.com/2010/03/global-urban-heat-island-effect-study-an-update/
        http://www.drroyspencer.com/2010/03/urban-heat-island-a-us-versus-them-update/
        I will read the BEST paper in detail when I get some time however these posts of Spencer’s and others, are a big red flag to me as far as the methodology used in the BEST UHI paper, I’m afraid. However I’m willing to be persuaded.