Did Federal Climate Scientists Fudge Temperature Data to Make It Warmer?

Reason Foundation's picture
Printer-friendly versionPrinter-friendly versionPDF versionPDF version

Practicing the Dark Art of Trend Adjustment

July 3, 2014

Dreamstime: Meryll"Right after the year 2000," climate change skeptic Tony Heller claimed last month, federal climate scientists "dramatically altered US climate history, making the past much colder and the present much warmer....This alteration turned a long term cooling trend since 1930 into a warming trend." Heller (nom de blog Steven Goddard) says that these adjustments " cooled 1934 and warmed 1998, to make 1998 the hottest year in US history instead of 1934."

Heller's assertions induced a frenzy of commentary, attracting the attention of The Drudge Report, the Telegraph, The Daily Caller, and Fox News. A few days later, the hullabaloo was further stoked by reports that scientists at the National Climatic Data Center (NCDC) had quietly reinstated July 1936 as the hottest month on record in the continental U.S. instead of July 2012. (For the record, the National Oceanic and Atmospheric Administration—the NCDC's parent agency—has declared 2012 the hottest year on record for the lower 48 states, and the months between August 2011 and July 2012 as the hottest 12-month period

In response to the brouhaha, the NCDC press office sent out a rather defensive statement noting that its new U.S. temperature dataset based on climate division adjustments has, indeed, restored July 1936 to its hellish pinnacle. "We recalculate the entire period of record to ensure the most up-to-date information and to ensure proper comparison over time," said the press release (which, oddly, is not available online). "In this improved analysis, July 1936 is now slightly warmer than July 2012, by a similar very small margin." It added that this "did not significantly change overall trends for the national temperature time series" and that the "year 2012 is still easily the warmest on record."

But never mind the quibbling over which month in the past century was the hottest. Is Heller right when he claims that NCDC scientists are retrospectively fiddling with the national thermostat to bolster the case for man-made global warming?

The answer is complicated.

When Heller produced his temperature trend for the continental United States, he basically took the raw temperature data from the U.S. Historical Climatology Network from 1895 to the present and averaged them. He made no adjustments to the data to take into account such confounders as changes in location, equipment, time of observation, urban heat island effects, and so forth. Heller argues that these changes more or less randomly cancel out to reveal the real (and lower) trend in average U.S. temperatures.

In contrast, the researchers at the NCDC have spent years combing through U.S. temperature data records trying to figure out ways to adjust for confounders. In 2009, the NCDC researchers detailed how they go about adjusting the temperature data from the 1,218 stations in the Historical Climatology Network (HCN). They look for changes in the time of observation, station moves, instrument changes, and changes in conditions near the station sites (e.g., expanding cities). They filter the data through various algorithms to detect such problems as implausibly high or low temperatures or artifacts produced by lazy observers who just keep marking down the same daily temperatures for long periods.

They've clarified a lot this way. For example, simply shifting from liquid-in-glass thermometers to electronic maximum-minimum temperature systems "led to an average drop in maximum temperatures of about 0.4°C and to an average rise in minimum temperatures of 0.3°C." In addition, observers switched their time of observation afternoon to morning. Both of these changes would tend to artificially cool the U.S. temperature record.

Urban areas are warmer than the countryside, so previous NCDC researchers had to adjust temperature datasets account for the effects of urban growth around weather stations. The center's 2009 study conceded that many HCN stations are not ideally situated—that they now sit near parking lots, say, or building HVAC exhausts. Such effects tend to boost recorded temperatures. The researchers argue that they do not need to make any explicit adjustments for such effects because their algorithms can identify and correct for those errors in the temperature data.

Once all the calculating is done, the 2009 study concludes, the new adjusted data suggests that the "trend in maximum temperature is 0.064°C per decade, and the trend in minimum temperature is 0.075°C per decade" for the continental U.S. since 1895. The NCDC folks never rest in their search for greater precision. This year they recalculated the historical temperatures, this time by adjusting data in each of the 344 climate divisions into which the coterminous U.S. is divvied up. They now report a temperature trend of 0.067°C per decade.

The NCDC have also developed a procedure for infilling missing station data by comparing temperatures reported from the nearby stations. Why? Because as many as 25 percent of the original stations that comprised the HCN are no longer running. Essentially, the researchers create a temperature trend for each missing station by interpolating temperature data from nearby stations that are still operating. Skeptics like Heller argue that that the virtual "zombie stations" that infill missing data have been biased to report higher than actual temperatures.

Some sort of infilling procedure needs to be done. Let's say that there are records from five stations, all of which report time series of 1, 2, 3, 4, and 5. The average of each therefore comes to 3. If two stations fail to report on the second day, missing records of 2, then the average of their remaining four records is now 3.25 instead of 3. In trying to address the problem of missing data from closed stations, the NCDC folks average other stations to fill in the absent 2s. According to climate change skeptic blogger Brandon Shollenberger, what Heller does is the equivalent of averaging the raw data from the notional five stations to report 3, 3, 3, 3.25, and 3.25. "He'd then accuse the people of fraud if they said the right answer was 3, 3, 3, 3, 3," Shollenberger writes.

Let's assume that all of the NCDC's adjustments are correct. What do they reveal? The center's 2009 study concluded, “Overall, the collective effect of changes in observation practice in the U.S. HCN stations is the same order of magnitude as the background climate signal (e.g., artificial bias in maximum temperatures is about -0.04°C per decade compared to the background trend of about 0.06°C per decade). Consequently, bias adjustments are essential in reducing the uncertainty in climate trends.” In other words, the asserted bias is almost as big as the asserted trend. Even with the best intentions in the world, how can the NCDC be sure that it has accurately sorted the climate signal from the data noise such that it has in fact reduced the uncertainty in climate trends?

Well, for one thing, other scientists have found a similar trend. Another group of researchers at Berkeley Earth use a different statistical method in which any significant changes to the temperature record of any station are treated as though a new station had been created. They use eight times more data than the NCDC does. Via email, Berkeley Earth researcher Zeke Hausfather notes that Berkeley Earth's breakpoint method finds "U.S. temperature records nearly identical to the NCDC ones (and quite different from the raw data), despite using different methodologies and many more station records with no infilling or dropouts in recent years." He is also quite critical of Heller's simple averaging of raw data.

The NCDC also notes that all the changes to the record have gone through peer review and have been published in reputable journals. The skeptics, in turn, claim that a pro-warming confirmation bias is widespread among orthodox climate scientists, tainting the peer review process. Via email, Anthony Watts—proprietor of Watts Up With That, a website popular with climate change skeptics—tells me that he does not think that NCDC researchers are intentionally distorting the record. But he believes that the researchers have likely succumbed to this confirmation bias in their temperature analyses. In other words, he thinks the NCDC's scientists do not question the results of their adjustment procedures because they report the trend the researches expect to find. Watts wants the center's algorithms, computer coding, temperature records, and so forth to be checked by researchers outside the climate science establishment.

Clearly, replication by independent researchers would add confidence to the NCDC results. In the meantime, if Heller episode proves nothing else, it is that we can continue to expect confirmation bias to pervade nearly every aspect of the climate change debate.

Editor's Note: We invite comments and request that they be civil and on-topic. We do not moderate or assume any responsibility for comments, which are owned by the readers who post them. Comments do not represent the views of Reason.com or Reason Foundation. We reserve the right to delete any comment for any reason at any time. Report abuses.

  • Dances-with-Trolls||#

    We live in a climate with an unpredictable past.

    log in or register to reply

  • sarcasmic||#

    Clearly, replication by independent researchers would add confidence to the NCDC results.

    Phhht! That's old science. We've got consensus now!

    log in or register to reply

  • Longtorso, Johnny||#

    The answer is complicated.

    That would be a 'yes'.

    log in or register to reply

  • Mike M.||#

    And most of America figured this out about five years ago. Reading Reason is starting to make me feel like I've entered a Wayback Machine or something.

    log in or register to reply

  • DanD||#

    Well, let's see. They're incentivized, both directly and implicitly, to create a story of a dire situation. They won't share their methods for acquiring their data, and they are hostile to reasonable criticism.

    I think the answer here is pretty clear.

    log in or register to reply

  • kinnath||#

    History is written by the victors . . . . and federally-funded bureaucrats.

    log in or register to reply

  • brokencycle||#

    You're just on the wrong side of history.

    log in or register to reply

  • New Normal||#

    Hmm it's rather muggy outside today. I need to go calculate the temperature and adjust it accordingly.

    log in or register to reply

  • Drake||#

    "...we can continue to expect confirmation bias to pervade nearly every aspect of the climate change debate."

    That sounds nicer than Bullshit.

    log in or register to reply

  • tarran||#


    Why did you decide to exclude Watt, Pielke, et al's identification of significant siting issues through his Surface Stations project from this overview?

    Why also not acknowledge that over the past week there has been a shift towards people accepting Goddard's claims of serious defects in the value added data set - when you originally published Watt's initial argument that he didn't think Goddard was right?

    log in or register to reply

  • tarran||#

    What is going on is that the USHCN code is that while the RAW data file has the actual measurements, for some reason the final data they publish doesn’t get the memo that good data is actually present for these stations, so it “infills” it with estimated data using data from surrounding stations. It’s a bug, a big one. And as Zeke did a cursory analysis Thursday night, he discovered it was systemic to the entire record, and up to 10% of stations have “estimated” data spanning over a century:

    log in or register to reply

  • Dances-with-Trolls||#

    And seriously Reason, Climate Change Chicanery?

    Since this morning's links there has been an article on stupid regulations, the unfolding Obamacare disaster, the recent Hobby Lobby ruling, another article on stupid regulations, and the free(-ish) press being on life support in the UK.

    Meanwhile there was just one (ONE!) article about pot and nothing at all about ass-sex and Mexicans! Why aren't you writing about the things we truly care about and wasting our time talking about all this other fluff?

    You Reason paleotarians are almost unbearable at times. You keep pushing this stuff and ignoring the critical issues of the day and before you know it you may have the freedom to buy weird food or light a firecracker without the threat of being fined or being thrown in a rape cage, but when you want to celebrate with some MJ fuled buttsex with your undocumented manservant you will find the heavy hand of the government has got you by the balls.

    What then?! Huh?!

    log in or register to reply

  • Swiss Servator, CH verlort :(||#

    Maybe they can do a three-in-one ...

    Mexican medicinal pot use during ass-sex?

    Pot legal, ass-sex legal, Mexicans not???

    Is pot fueled Mexican ass-sex the new GoT theme?

    log in or register to reply

  • kilroy||#

    In addition, observers switched their time of observation afternoon to morning.

    If the purpose of your data collection is historical analysis of time-series data, why would you ever do this?

    log in or register to reply

  • kinnath||#

    why would you ever do this?

    Stupid inclusive-or dishonest

    log in or register to reply

  • Raston Bot||#


    Maine republican governer is a cop-killing domestic terrorist...


    LePage held eight meetings with individuals connected to the sovereign citizens movement, a loosely affiliated group of individuals who challenge the authority of state and federal governments. The FBI says individuals connected with the movement have been responsible for the murder of six police officers since 2000.

    Therefore the republican governor of Maine is directly responsible for killing six cops since 2000.

    log in or register to reply

  • The DerpRider||#

    CDC tells drowsy drivers to not hit the road. I was unaware that being sleepy was a disease. We're all fucked.

    log in or register to reply

Leave a Comment

You must have an account and be logged in to comment.
Click here to register, or here to login if you already have an account
News Source : Did Federal Climate Scientists Fudge Temperature Data to Make It Warmer?
Copy this html code to your website/blog to embed this press release.