... The recent illegally obtained emails from the University of East Anglia’s Climatic Research Unit (so-called ‘Climategate’) and the subsequent accusations of secrecy and malpractice from climate change sceptics have provoked debate in the media about the openness and availability of datasets related to climate change.
Partly in response to accusations of secrecy and falsification of key datasets from sceptics, the UK Met Office announced today they will be publishing new climate datasets. Earlier the Telegraph reported:
Sceptics alleged that emails stolen from the Climatic Research Unit at the university show scientists were willing to manipulate data to show global warming.
They also complain that the raw data for the climate models was not made available to the public. ...
Meanwhile, the Met Office said it would publish all the data from weather stations worldwide, which it said proved climate change was caused by humans. ...
It has written to 188 countries for permission to publish the material, dating back 160 years from more than 1,000 weather stations.
As [the University of East Anglia] said in an announcement from the end of November, over 95% of the CRU climate data is already available and permission to publish the remaining data will have to be sought from each of the relevant National Meteorological Services (NMSs) around the world on a case by case basis. Professor Davies of UEA, suggests there are partly commercial reasons for this:
We are grateful for the necessary support of the Met Office in requesting the permissions for releasing the information but understand that responses may take several months and that some countries may refuse permission due to the economic value of the data.
Researchers are barred from publicly releasing meteorological data from many countries owing to contractual restrictions. Moreover, in countries such as Germany, France and the United Kingdom, the national meteorological services will provide data sets only when researchers specifically request them, and only after a significant delay. The lack of standard formats can also make it hard to compare and integrate data from different sources. Every aspect of this situation needs to change: if the current episode does not spur meteorological services to improve researchers’ ease of access, governments should force them to do so. ...
While it is important to remember, as Cameron Neylon notes, that proper interpretation of climate change data requires significant background knowledge and a thorough grounding in relevant scientific literature and tools, nevertheless it is clear that there is an increasing demand from interested non-expert non-scientists to access and reuse climate data. ...
... [E]ven if the hacked emails from HADCRU end up to be much ado about nothing in the context of any actual misfeasance that impacts the climate data records, the damage to the public credibility of climate research is likely to be significant. In my opinion, there are two broader issues raised by these emails that are impeding the public credibility of climate research: lack of transparency in climate data, and “tribalism” in some segments of the climate research community that is impeding peer review and the assessment process.
1. Transparency. Climate data needs to be publicly available and well documented. This includes metadata that explains how the data were treated and manipulated, what assumptions were made in assembling the data sets, and what data was omitted and why. This would seem to be an obvious and simple requirement, but the need for such transparency has only been voiced recently as the policy relevance of climate data has increased. ... [G]iven the growing policy relevance of climate data, increasingly higher standards must be applied to the transparency and availability of climate data and metadata. These standards should be clarified, applied and enforced by the relevant national funding agencies and professional societies that publish scientific journals. ...
I have some sympathy for Phil Jones’ concern of not wanting to lose control of his personal research agenda by having to take the time to respond to all the queries and requests regarding his dataset, but the receipt of large amounts of public funding pretty much obligates CRU to respond to these requests. The number of such requests would be drastically diminished if all relevant and available data and metadata were made publicly accessible, and if requests [under public records laws] were honored ...
But the broader issue is the need to increase the public credibility of climate science. This requires publicly available data and metadata ...
Posted by
Gavin Baker at 12/07/2009 02:09:00 PM.
The open access movement:
Putting peer-reviewed scientific and scholarly literature
on the internet. Making it available free of charge and
free of most copyright and licensing restrictions.
Removing the barriers to serious research.
I recommend the OA tracking project (OATP) as the best way to stay on top of new OA developments. You can read the OATP feed on a blog-like web page or subscribe to it by RSS, email, or Twitter. You can also help build the feed by tagging new developments you encounter.
