Wilderness Society on Planning Rule- Science in the Front Seat?

What I found most interesting about this pieces by Cecilia Clavet of The Wilderness Society, given the lecture by Toddi Steelman here, is asking “who is saying that science should determine policy?” and “in what context do they say it?”.

Here we have an example of the perceived need for science to “take a front seat” in the planning rule, in the context of public comment on the rule. So we are perhaps expecting that those of us not familiar with the issues would simply write a letter calling for 1) more rules about collaboration, and 2) science taking a “front seat.”

I’m beginning to think that their are two problems:a) the discussion isn’t really as nuanced as it could be about what is a “foundation” compared to “scientists should determine what happens”- a mildly (at least) undemocratic idea. And perhaps some policy folks, lawyers and editors have never been exposed to the true messiness of scientists, scientific agendas, and political agendas all duking it out in some controversy. Or they have seem it (in the climate world, it’s hard to avoid) and chosen to look away.

Time to speak up on rules governing how our forests are managed
Photo

By Cecilia Clavet on March 17, 2011 – 2:28pm

The Obama administration and the Forest Service last week hosted what they call a national roundtable. It was an effort to summarize and explain in detail the various components of the draft forest planning rule, which was published last month. When final, this rule will guide the Forest Service on how to manage 193 million acres of America’s national forests. The roundtable, held in Washington D.C., was the beginning of a series of public forums that will take place throughout the country.

The components covered a range from climate change to timber production and from recreation to water resource management. However, much of the day’s emphasis was on the role of collaboration. The draft rule requires collaboration to take place when individual forest plans are developed. This in theory means that the Forest Service will reach out to a wide variety of people interested in contributing to plans for managing forests. These stakeholders include scientists, conservationists, local land owners, foresters and other concerned citizens.

While this sounds like a very inclusive process, a couple of concerns come to mind:

First the planning rule does not provide guidelines to ensure good collaboration, leaving all discretion to the forest manager. The excuse against collaboration guidelines is that no collaborative will be the same across the landscapes. However, I would argue that you can follow some basic rules on collaboration by adopting similar guidelines to the Collaborative Forest Landscape Restoration Program, which would ensure some consistency across all the collaborative efforts and ensure all the right stakeholders are invited to the tables. This will in turn provide the appropriate check on the agency as it developed new forest plans.

The second concern is that the emphasis on collaboration that could minimize, and thus weaken, the role of science in decision-making. The administration appears to view collaboration as having equal footing with science. While collaboration is a complementary component of the forest planning process, the agency must require that the best available science is the foundation. A New York Times editorial also raised some questions the Forest Service needs to answer about science and protecting wildlife.

These are the concerns about collaboration, and there are others. In last week’s roundtable, the administration and agency staff spoke a lot about the intent of the rule, stressing the importance of water, wildlife and sustainable recreations and addressing new challenges like climate change. We wholeheartedly agree. The problem we find is that the language of the draft rule doesn’t match the intent. However, the agency is able to make some changes that could have very meaningful impact to sound forest management.

Now that the draft of the forest planning rule is out, it’s up to everyone who cares about our national forests to make our voices heard. We can start by attending the roundtables taking place across the country. More importantly, we can visit the Forest Service’s forest planning rule site and make official comments about what we would like the agency to do as it revises the draft. We should start by calling for more clarity on collaboration and by demanding science take a front seat in the process.

Note that the NY Times editorial mentioned is the same one I critiqued in my blog entry “NY Times Editors Need New Nemesis” which included the quote “The net result is to give too much discretion to individual forest managers and not nearly enough say to scientists. This is dangerous because, over the years, forest managers have been easily influenced by timber companies and local politicians whose main interest is to increase the timber harvest. ”

Scorecard- Scientists /science as drivers..
NY Times 1
Wilderness Society 1

Toddi Steelman on Science and Politics

 

At a recent TED lecture at North Carolina State University, Professor Toddi Steeman talked about three science myths: “Science Determines Policy,” “Science is Objective,” and “More Science Leads to Consensus.” Steelman titled the talk, “My Jihad Against Scientific Fundamentalism.” Beginning about 7:50 into the presentation Steelman talks about so-called “Climategate,” as one of two case studies where misplaced emphasis on science frustrates policy development and problem solving. Here is a “snip,” [hastily transcribed from audio, beginning at 12:57]:

More, better, new science cannot provide objective answers to value-based questions. Science is actually pretty good at helping us understand problems, but is really not so good at helping us understand solutions to those problems. … Politics is the realm where we shape and share our collective values as a society. And politics requires different forms of knowledge, including local knowledge and public preferences. …

Knowledge like “public preferences” and “local knowledge” are often dismissed outright when we talk about environmental issues because they are seen as flawed in some fundamental way. They are seen as biased or not objective or not neutral. In that type of framing science is actually seen to be a more perfect form of knowledge … seen as … less biased or more objective or more neutral. … And under that type of framing [science] is a preferred or privileged form of knowledge in environmental decision-making. … The question is, Should it be that way?

Under that type of framing politics is really vilified. It is seen as a dirty, spin-filled, nasty practice full of compromise and collaboration in the absolute worst sense of those words. And because it is portrayed that way or framed that way it is easy to dismiss these other forms of knowledge….We are sort of left with having science to fill this gap. … But the question is, Should it be that way? …

Science can’t tell us what to do as individuals or as a collective society in the face of a changing climate. We have to make those hard decisions and engage in that debate collectively. And yet we continuously look to science to provide those answers for us. So the question again is, Why? Why do we do that? …

We continue to place these expectations on science—that science really cannot meet. And in doing so we really do an enormous disservice to science. …What we really need to do is to elevate the political dialogue in our society and to take the expectations on science down a little bit. …

We could continue to perpetuate the [three science myths above]. … And in doing so we do an enormous disservice to science … Or, the alternative vision is to acknowledge what those myths are and to embrace politics and the really constructive role it can potentially play for us. And in doing so what we could do is accept what science can do and what its strengths are, as well as what local knowledge can do for us, as well as what public preferences can do for us. And in leveraging all three of those knowledge types perhaps get better purchase on some of these contested claims in the environmental arena. Because the challenges we face in our environmental arena are so wide and so challenging we need all the help that we possibly can get.

Roger’s Advice for Scientists Testifying before Congress

These are from a post by Roger Pielke Jr. on his blog here, I thought they also might be relevant to our sorts of science.

What are the lessons here for experts who testify before Congress?

I can think of several:

1. Decide what your role is. Regardless of which party invites you, decide whether you are there to defend that political party’s views (on science or policy) or if you are there to share what you know about questions for which you have expertise. These are not always the same thing.

2. Appreciate that statements that you make in the media that cherrypick, emphasize extremes (on any side of an issue) or otherwise go out on a limb could set your scientific colleagues up for difficulties in the future when they are asked to defend those statements in a political setting. At that point, the scientist being asked to defend the dodgy statements may face a trade-off between scientific accuracy and political solidarity.

3. Speak for yourself and let others speak for themselves. This is of course can be very difficult when participating in a shared campaign, either for action or a perspective. Even if you are not actively participating in that campaign you may be forced to render a judgement on it, e.g., “Ms. Scientist the IPCC consensus says X, what do you think?”

4. Recognize that when incorrect statements are made in a public setting, the consequences for you as an expert will be much higher than for politicians. That is just the way that it is. The consequences for folksy, grandfatherly Ralph Hall of being wrong will never be as significant as for a scientist testifying before him. So always be able to defend claims that you make.

5. Stick to your area of expertise when testifying as an expert. This seems obvious but is routinely violated.

6. Finally, it should be obvious that a decision to accept an invitation to testify is a political act. No, it does not mean that you shared the political agenda or scientific views of those who invite you. But it does mean that your participation in the process will be more thoughtful and more effective if you have considered your role in the political process, and especially your stance on advocacy versus arbitration. The risk of not thinking these issues through is of course a greater likelihood that you’ll simply be a stage prop in a political theater.

On sea level rise, the statements made by Holdren in 2006 to the BBC as AAAS President and environmental activist were far less measured and responsible than his statements made in 2009 and 2011 on the same subject as science advisor to the president before Congress. The difference — which I attribute as much to setting as to any changes in the science of sea level — helps to illustrate the difference between an expert who seeks to use science selectively as a basis for political advocacy and one who wishes to faithfully arbitrate scientific questions for policy makers. While these roles are not necessarily mutually exclusive, typically a choice must be made.

ENS Article on Planning Rule Forum- Expecting Too Much From a Planning Rule?

Here it is, with some quotes below.

But Defenders of Wildlife says the draft rule ignores scientific recommendations on wildlife diversity protection.

Rodger Schlickeisen, president and CEO of Defenders of Wildlife said, “President Obama holds the future of our nation’s forests and wildlife heritage in his hands as his administration crafts the new rule governing national forest policy. His administration has an opportunity to lead us into a new century of forest management. Unfortunately, in its present form, the draft rule promises much more than it delivers, leaving the future of wildlife on 193 million acres of land belonging to the American people mostly up to chance.”

The nonprofit Sierra Forest Legacy, based in California, says, “At first reading, we note that the single most important measurable protection to ensure protection of wildlife, afforded by the 1982 regulations, has been removed entirely.”

The group is referring to the “Viability Standard” at 219.19 in the 1982 regulations, which states, “Fish and wildlife habitat shall be managed to maintain viable populations of existing native and desired non-native vertebrate species in the planning area.”

The 1982 Viability Standard continues, “For planning purposes, a viable population shall be regarded as one which has the estimated numbers and distribution of reproductive individuals to insure its continued existence is well distributed in the planning area.”

“In order to insure that viable populations will be maintained, habitat must be provided to support, at least, a minimum number of reproductive individuals and that habitat must be well distributed so that those individuals can interact with others in the planning area,” the Viability Standard concludes.

The Sierra Forest Legacy warns, “Without such clear direction for protecting wildlife, the new planning rule represents a step backward, suggesting that the agency has abdicated its long held responsibility for maintaining our national forests as the last refuge for the continent’s increasingly imperiled wildlife.”

Marty Hayden, vice president of policy and legislation with the public interest law firm Earthjustice, said, “The Forest Service’s draft rule shows that the Obama administration understands and supports the basic concepts of how to protect the indispensible watersheds on our National Forests, but, by failing to adopt enforceable standards, it falls short of guaranteeing the protections our country desperately needs.”

And

But conservationists are not convinced the draft planning rule will protect waters and wildlife. “It’s not just the streams, rivers, and wetlands outside my back door and yours that remain in trouble. Waters across the nation are threatened by a legacy of serious harm from forest and grazing land use on National Forest lands,” said Dr. Chris Frissell, director of science and conservation for the Pacific Rivers Council.

“This history is a principal reason why our native trout and salmon are in such tough shape today, and this means the new planning rule will need to take firm steps forward, not backward, to ensure the health of our watersheds and fisheries is restored,” he said.

“The rule still needs, among other things, clear direction to reduce harm to watersheds by removing and restoring forest roads, an established national minimum streamside buffer zone, and development and compliance with firm standards protecting waters and aquatic life,” said Dr. Frissell. “Good intentions are great, but in an ecosystem as complicated as a watershed, standards and a commitment to real monitoring are necessary to ensure that the agency’s actions in fact protect and restore the environment. This draft rule doesn’t get us there. ”

On the proposed rule’s treatment of science, Dr. Frissell said, “The rule still needs language to say it’s the Forest Service’s job to both bring the best available scientific information to the table and to actually use it as the basis for planning, and to implement and monitor the measurable standards that are necessary to ensure water resources and watershed health are in fact being protected and restored.”

I don’t know what Dr. Frissell means by using science as “the basis” for planning. But I also ran across testimony of Dr. Pielke, Sr. on climate change this week.

Decisions about government regulation are ultimately legal, administrative, legislative, and political decisions. As such they can be informed by scientific considerations, but they are not determined by them. In my testimony, I seek to share my perspectives on the science of climate based on my work in this field over the past four decades.

For those of you unfamiliar with his work, he describes other forcings than CO2 in a way accessible to the public (or at least, me) in his testimony here.

Stirling on Science and Skepticism

Andy Stirling is Research Director for SPRU and co-directs the ESRC STEPS Centre at the University of Sussex. He has served on a number of science advisory bodies.

This quote is relevant to recent discussion between David Beebe and me here. It’s always a great discovery when others agree with you and they are also 20 x more articulate (plus have social legitimacy)! The entire post is well worth reading for its discussion of the science biz.

[T]he basic aspirational principles of science offer the best means to challenge the ubiquitously human distorting pressures of self-serving privilege, hubris, prejudice and power. Among these principles are exactly the scepticism and tolerance against which Beddington is railing (ironically) so emotionally! Of course, scientific practices like peer review, open publication and acknowledgement of uncertainty all help reinforce the positive impacts of these underlying qualities. But, in the real world, any rational observer has to note that these practices are themselves imperfect. Although rarely achieved, it is inspirational ideals of universal, communitarian scepticism—guided by progressive principles of reasoned argument, integrity, pluralism, openness and, of course, empirical experiment—that best embody the great civilising potential of science itself. As the motto of none other than the Royal Society loosely enjoins (also sometimes somewhat ironically) “take nothing on authority”. In this colourful instance of straight talking then, John Beddington is himself coming uncomfortably close to a particularly unsettling form of unscientific—even (in a deep sense) anti-scientific—’double speak’.

Anyone who really values the progressive civilising potential of science should argue (in a qualified way as here) against Beddington’s intemperate call for “complete intolerance” of scepticism. It is the social and human realities shared by politicians, non-government organisations, journalists and scientists themselves, that make tolerance of scepticism so important. The priorities pursued in scientific research and the directions taken by technology are all as fundamentally political as other areas of policy. No matter how uncomfortable and messy the resulting debates may sometimes become, we should never be cowed by any special interest—including that of scientific institutions—away from debating these issues in open, rational, democratic ways. To allow this to happen would be to undermine science itself in the most profound sense. It is the upholding of an often imperfect pursuit of scepticism and tolerance that offer the best way to respect and promote science. Such a position is, indeed, much more in keeping with the otherwise-exemplary work of John Beddington himself.

Comments on “Scientific Integrity”

Interesting things about blogs.. I decided to look at how people got to this blog and noticed that some were linking from Judith Curry’s climate blog here. Turns out that they are having a discussion of some of the points in the post I wrote for Roger Pielke Jr.’s blog, with many more comments (318) than at Roger’s blog here (2, so far) or when I posted it here (0). So if you are interested in this discussion, check it out.

Here’s a quote from her post.

Sharon… makes the following four recommendations:

Here are my four principles for improving the use of information in policy, (1) joint framing and design of research with policymakers (2) explicit consideration of the relevance of practitioner and other forms of knowledge (3) quality measures for scientific information (including QA/QC, data integrity and peer and practitioner review), and (3) transparency and openness of review of any information considered and its application to policy.

The bolded statement is of particular relevance to this topic. In the politics of climate expertise, which experts should be paid attention to?

Steve Schneider had very clear views on this, as evidenced in this interview with Rick Piltz shortly before his death, about the PNAS paper. It is the elite climate scientists (which includes geophysical scientists, ecologists and economists) as judged by their number of publications and citations. Many reputable scientists such as Syun Akasofu (a solar physicist and climate skeptic) were not included in the statistics because he had not published more than 20 papers that were judged to be on the topic of climate. Seems to me that Akasofu has more knowledge about detection and attribution than nearly all of the biologists and economists included in the “list”?

Given the breadth of the topic of climate change, its impacts, and policy options, it seems that considerable breadth of expertise is needed, i.e. “all hands needed on deck.” But there seems to be a turf battle over “which experts,” as evidenced by the PNAS paper and the continued appeal to the IPCC consensus.

More on the “Scientific Integrity” Memo

Here’s a link to another of my posts on this topic on Roger Pielke, Jr.’s blog.

My concern is that it is not clear what problem the memo is intended to solve. I am not sure that the authors are aware of the dailiness of using science in a variety of government decisions at different spatial and temporal scales. In clumsily attempting to go after the misbehaving, they are likely to target the innocent for unnecessary work. In this economic climate, one would think that people would be more careful about requiring hordes of federal employees to develop and follow unclear and unnecessary policies.

Here’s my summary of the memo (more on the guidelines later).

1. What if we were to apply the ideas espoused in the memo to the promulgation of the memo (as the memo is policy) itself? We might expect a section describing how the work of noted science policy experts was used in the development of the memo, with peer-reviewed citations. I’d expect to see Jasanoff, Sarewitz and Pielke, Jr., at least, cited.

2. Here are my four principles for improving the use of information in policy, (1) joint framing and design of research with policymakers (2) explicit consideration of the relevance of practitioner and other forms of knowledge (3) quality measures for scientific information (including QA/QC, data integrity and peer and practitioner review), and (3) transparency and openness of review of any information considered and its application to policy.

3. If the DQA (Data Quality Act) and the “Integrity” work are seen to be the result of inchoate longings by many for an improved “science to policy” process; and if they seem each to have become, instead, weapons to slime the opposing political party, then why not establish a bipartisan commission on improving the use of scientific and technical information in policy? Science policy experts would advise the commission, and the deliberations would be transparent and open to public comment. The terrain to be explored would include my four principles above, and add considerations of involving citizens more directly in working with the relevant Congressional committees in developing federal research budgets and priorities.

My Take on the “Science Integrity” Guidelines

If you haven’t been following this issue, OSTP (the Office of Science and Technology Policy in the Executive Office of the President) (for whom I once worked on agbiotech regulation- great perks, BTW, highly recommended as a DC experience!) released some guidelines, based on a President’s Memo, here.

Some people are aware of the situations which apparently triggered the perceived need for these guidelines. However, it is not really clear at this point what those were, nor how the memo or the guidelines would help resolve similar problems. As regular readers know, I am a fairly concrete thinker. It could just be that the concepts are too abstract for me. Nevertheless, in some old jobs I’ve had, I would be one of the folks in the agencies charged with implementing the guidelines. I can’t help but think we have better uses for the time of a small army of GS-14s and 15s than writing more policy on something that doesn’t seem very clear. Or even necessary, if we can’t clearly articulate what we are trying to keep others from doing. Even in our humble daily world of administrative appeals, we try to link facts found and conclusions drawn.

Also of concern is that Roger argues that in some cases the problem was not caused by the agencies (who are required to “fix it”) but by the EOP, when the agencies “did it right.” See his comments here.

By the way, if this is a policy on the use of science in policy development, then its development should follow its own rationale- it should use science and technology policy scholars (e.g., Jasanoff, Pielke, Sarewitz) to give scientific advice in its development.

Anyway, in this guest post for Roger Pielke, Jr.’s blog, I attempt to make sense of the President’s memo. Also, the comments and thought of David Bruggeman are of interest. My post is part of a series on Roger’s blog.

The New Yorker on the Decline Effect

A colleague sent this link to me.. for sheer curiousity, it’s hard to beat.

The decline effect is troubling because it reminds us how difficult it is to prove anything. We like to pretend that our experiments define the truth for us. But that’s often not the case. Just because an idea is true doesn’t mean it can be proved. And just because an idea can be proved doesn’t mean it’s true. When the experiments are done, we still have to choose what to believe