The recent attention to a forthcoming paper ‘replicating’ the Oreskes procedure of 2004, [ostensibly contradicting it, but there are some problems...], and the timely return of Bray & von Storch, shows that there is still interest in the question of whether there is a scientific ‘consensus’ on climate change.
A couple of days ago, I suggested that it was useful to know what scientists think as a group because it adds to public confidence in the results and their implications. I am now less sure of this argument; speaking with rational non-scientists over the weekend has led me to believe that this is not a fair assumption to make: the problem of trust between the public and science may be much deeper than this.
If this is the case, then a ‘unanimous’ scientific voice is of lesser importance in the public debate. It may sway opinion indirectly, or serve to move the frame of debate somewhat, but it cannot change the underlying uncertainty which besets many people when confronted with unpleasant or uncomfortable scientific discoveries or ideas.
That being said, there is still value to assessing the degree to which climate scientists’ views on climate change represent a ‘consensus’.
The first observation is that, in one form at least, consensus already exists. Inasmuch as each of the several reports by major bodies over the past decade represent the product on a consensus decision-making process of some kind, these products are, ipso facto, the consensus of the group, panel, committee, or the participants.
It is known, though, that there are some [number not specified] climate scientists who have not been happy with the consensus as it stands. Some of these individual have published their objections or misgivings. What is also evident is that there are a number of groups or individuals who, for whatever motive, have a desire to discredit one or more [preferably all] of these examples. One of the methods for doing this is to provide evidence that, in spite of appearances, the product was not a true consensus, but some form of compromise, which did not resolve the differences between all the participants prior to being published.
Another important concern is that products such as the AR4 may be sufficiently compromised in terms of the consensus [or the way in which the consensus is reached] , as to render any claim that it represents a fair summary of current opinion as debatable.
Aligned to these worries are the informal observations which point out an ‘unease’ or ‘concern’ about the procedures or products of large reports, which are one part of a more difficult challenge to the authority of the reports, that to some extent it may be corrupted by feelings of force majeure, insecurity, hijacking or similar pressures. These may be subtle, imaginary, or real but insidious, if they exist at all. But if some of the participants feel as if they are under this kind of pressure, real or not doesn’t matter; the effect is to render the consensus less certain.
Given this, it then becomes meaningful to ask whether or not the reports, or the more general ‘feeling’ about climate change (or any issue, for that matter), are genuinely representative of a sufficiently strong majority agreement, such that they can be called a consensus at all.
This matters to policy makers in particular. If the reply to their questions about what, how much and when, relative to climate change , are framed in terms such as ; ‘well, a good bunch of us are happy to say this, but a few of us aren’t so sure…’, or ‘most scientists agree that…’ or, at the extremes; ‘the science is settled’ or ‘there is no agreement about any of it’, then it becomes much less likely that any concerted agreement amongst nations (which would have to be both a consensus on action and a commitment to act, plus a trust that each will keep its promise) can be reached in time for action to be valuable or meaningful.
The committees, panels, etc., are not well placed to test the hypothesis that their consensus is compromised by the sort of uncertainties illustrated above. If the ‘published consensus’ is to be accepted as the authority on the issues, then doubts about this should be looked at and, where possible, tested.
In a ideal situation, every climate scientist would be able to express, privately, and without fear of reprisal, their exact and unmodified opinion about the science of climate change, and about the apparent consensus. This information could then be collected, analysed and presented. Again, in an ideal case, opinions should be sought on specific matters; key statements by the panel (such as William suggests) or specific key findings, as Eli offers.
If such a test showed that the report represents a ‘true consensus’, then all well and good. If, though, it showed that at least some uncertainty exists which is not expressed in the report, then this represents a limit to the extent to which the authors can claim a high level of agreement.
It would be necessary, in doing this, to establish what would be acceptable as as sufficient number of dissenters (assuming that unanimity is almost never going to be a result) to render the product no longer a ‘true consensus’. This can probably be most fairly agreed upon by using statistical analysis methods, which can assign a order of standard deviations; this way, the test of consensus would be comparable to a test of other findings, and should be acceptable to any scientist.
Being of a known opinion myself, I know what I would like such a test to find; that a sufficient number of scientists are in sufficient agreement with certain statements, such as to state that a consensus exists about these statements. If it turns out, though, that this criterion is not met, this, too is important. It is particularly important to organisations such as the IPCC, as it can inform future practice and lead to ever greater accuracy and transparency in both the process and the product. In either case, something important and useful is learned.
This is unlikely to get much interest, as I seem to have written an essay rather than posted a blog entry, but sometimes the old man gets carried away…
HAND Y’awl.

12 comments
Comments feed for this article
September 4, 2007 at 4:45 am
John Mashey
Duplicate of one posted in Deltoid, in case you don’t look in there for a while.
Have you seen comment by “Chris”, #24 in
http://scienceblogs.com/strangerfruit/2007/08/oreskes_responds_to_schulte.php?
If Schulte paper is not publicly available:
]
a) How did Lord Monckton publish a lot of it weeks ago?
b) And you got a copy [you must not be a member of the public
I predict that yet more weird stuff will appear …
September 4, 2007 at 10:01 am
fergusbrown
Thanks for providing the link to an interesting discussion on the subject, John. Do we know that N.O. has not seen the paper? Even if she had not, the content of the Monckton article is sufficiently explicit as to permit all of Oreskes’ responses. The paper is peculiar in a number of ways. From correspondence with the doctor, it is clear that he is himself of the sceptical persuasion, so we must presume that he knew what he was doing when he conducted this work.
The doctor has found (it appears) three papers which can be legitimately claimed to disagree with the IPCC position (ie, Shaviv). Thus, he claims, there is no unanimity amongst climate scientists. It is less clear why this should matter in the slightest, but, if the Oreskes paper claimed unanimity, then one example of contradiction can be argued to disprove this (correctly or not is another matter).
The doctor’s other line of argument is that there is no evidence for a consensus about ‘catastrophic’ climate change (the thing which apparently worries his patients). As I said to him, he could have found this out by reading the AR4 SPM, or any of the assessments; it’s a straw man.
On b), I am a member of the public, inasmuch as I am neither a climate scientist nor a ‘politico’. I also have a bit of a reputation as an ‘article hound’, eg., finding the unfindable. You don’t expect me to give away all of my secrets, do you? At least one other blogger, perhaps two, have copies of the paper; I’ve no idea where they got them from…
I am hoping that the consensus question will arise again when (if) my EOS paper sees the light of day. Suffice it to say that the matter of scientific agreement is perhaps more complex than we might like it to be. If you trawl around the comments on this site, you’ll find a hint as to where to find a pre-pub of this.
Regards,
September 4, 2007 at 10:59 pm
John Mashey
No secrets …. but it will be interesting to see what happens when the dust settles on this one. I do find some interesting details, including a claim that Lord Monckton has had a bunch of surgical operations for endocrine problems, and was quite interested in refuting the Oreskes piece in May:
http://observer.guardian.co.uk/review/story/0,,2073267,00.html
September 5, 2007 at 12:25 am
Steve Bloom
Shaviv isn’t a climate scientist. He’s a bit in the Soon/Baliunas mold.
September 5, 2007 at 2:05 am
Steve Bloom
OK, Fergus, I finally broke down and read the paper. First, there’s a small error: The 3 in the histogram (the second red number from the left) should be 2. Also, I’ll go with Spencer and Bryson (not sure in which order) for the first two responses on the left.
On the substance, I’m afraid I think it has some problems. I would have cut a few of the undefined buzz-words out (e.g. catastrophic) since without being defined they were likely off-putting to people who would otherwise be OK with a given statement.
I notice that the statement that most closely approximates “the consensus” is fifth out of seven. Why wasn’t it the middle choice, and didn’t it bias things to not do so?
The opening phrase asks for opinions on the “physical science basis” but the choices include numerous unrelated terms (e.g. “need for mitigation,” “exaggerations with a political motive”) that combine the science with various conclusions about what the response ought to be.
Referencing the “physical science basis” also tells someone familiar with the AR4 that they’re not supposed to take into account the WG2 and 3 reports. Was that intentional? For some reason the WG1 report is named in 4 through 7 but not 1 through 3, but then as noted above 6 and 7 go far afield from the WG1 report.
In 5, “forecast” should be “projected.”
From 6: “Action to reduce human emissions of CO2 in order to mitigate against serious consequences is more urgent than the report suggests.” This statement can’t make any sense since the WG1 report doesn’t say how urgent things are.
I’ll stop there. Summing up, IMHO it could use a re-write.
September 5, 2007 at 8:58 am
fergusbrown
John; Schulte attempts to make two points,neither of which is problematic for Oreskes: first, that there is at least one published paper which disagrees with the IPCC consensus statement-test, so there is no unanimity (by the Oreskes measure). This is like applying a falsifiability criterion to O’s review. Trouble is, O doesn’t really make any universal statement, so it is trivial and an attempt to disprove a straw man. Second, that there is little evidence for ‘catastrophic’ climate change in the literature, based on the use of the term ‘catastrophe’ in papers. Apart from the fact that this is not a sensible measure, it is hardly a revelation to anyone who has actually read any scientific papers on CC in the past few years; another straw man. The best evidence Schulte came up with for (1) were the 7 papers mentioned here and elsewhere.
Steve: One can, if one chooses, be generous to Shaviv, but anyway, the Oreskes reviews does not stipulate a requirement for authorial credentials; it is a review of papers on the Web of Science, so if Shaviv’s paper is there, it should be counted. Of course, it doesn’t matter.
Thanks for the review of the paper. I’ll check the histogram again; for the buzz words and your comments on the framing of the choices, this is covered in the supplement, and relates to the way in which a respondent understands his/her position in relation the the ‘big picture’. The intention was to use a range of ‘stance-related’ phrases, to allow agreement with any one within each option.
Bias estimates are also dealt with in the supplement; I don’t think its online atm; if my co-authors are happy, I can always email you a doc. We tried very hard to allow for an expected bias which, in the end, didn’t appear, hence the generosity with the positioning of the statements.
On the question of a re-write: we expect to have to produce revisions to the paper when the editors get round to responding, assuming they intend to publish. I can’t re-write the questions on this paper, though, as that is how they went out and that is what respondents responded to (which doesn’t mean that the statements were ‘ideal’; Eli’s alternatives in his response earlier were useful in this respect).
If we get the chance to pursue the research (which will be my job in the first instance, and depends on my getting a place on a postgrad programme), there are many suggestions, including yours, which will be extremely useful. Thanks for taking the effort to read it and respond.
Regards,
September 7, 2007 at 7:25 am
John Mashey
Fergus: to further calibrate Schulte, you may want to look at:
http://scienceandpublicpolicy.org/sppi_reprint_series/open_letter_in_response_to_namoi_oreskes_criticisms.html
and
http://scienceandpublicpolicy.org/press_releases/schulteresponse.html
Schulte demands apologies … which seems akin to closing your eyes, crashing your car into someone’s living room, and then demanding an apology because your car is wrecked.
http://www.desmogblog.com/the-endocrinologist-the-viscount-of-brenchley-and-the-dc-think-tank
has some more detail on SPPI.
Schulte has fallen in with a bad lot.
September 7, 2007 at 9:49 am
fergusbrown
Thanks, John: I think I’m going to respond to this, after the dof has had her walk.
September 7, 2007 at 12:35 pm
Tony
Sorry, what does EPW stand for?
September 7, 2007 at 12:45 pm
fergusbrown
Hi, Tony. Environment and Public Works. These people: http://epw.senate.gov/public/index.cfm?FuseAction=Minority.Blogs&ContentRecord_id=84e9e44a-802a-23ad-493a-b35d0842fed8
hope that link works.
September 7, 2007 at 1:20 pm
Tony
Ah, Marc Morano. ‘Nuff said. ^^
September 7, 2007 at 3:46 pm
fergusbrown
I have written a new post on this subject, following on from john’s excellent research… ‘The truth will out…’