Uncertainty and Decision Making 4 Presence of uncertainty is one of the most significant characteristics of environmental management decisions –Statistical.

Slides:



Advertisements
Similar presentations
Chapter 2 - What is Science?
Advertisements

The Natural Disturbance Regime: Implications for Forest Management Glen W. Armstrong University of Alberta CIFFC Science Forum 4 November 1999.
1 G Lect 2a G Lecture 2a Thinking about variability Samples and variability Null hypothesis testing.
Estimation of Sample Size
The Fundamentals of Conservation Design Image by Rex Johnson.
BHS Methods in Behavioral Sciences I April 25, 2003 Chapter 6 (Ray) The Logic of Hypothesis Testing.
Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?
HYPOTHESIS TESTING Four Steps Statistical Significance Outcomes Sampling Distributions.
Using Statistics in Research Psych 231: Research Methods in Psychology.
DATA ANALYSIS I MKT525. Plan of analysis What decision must be made? What are research objectives? What do you have to know to reach those objectives?
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
458 Population Projections (policy analysis) Fish 458; Lecture 21.
Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.
Statistics Micro Mini Threats to Your Experiment!
The Price of Precaution and the Ethics of Risk Christian Munthe Department of Philosophy, Göteborg University Based on: Munthe C, The Morality of Precaution:
Sampling Designs and Techniques
Using Statistics in Research Psych 231: Research Methods in Psychology.
The t Tests Independent Samples.
Descriptive Statistics
Statistical hypothesis testing – Inferential statistics I.
Inferential Statistics
POLS 7000X STATISTICS IN POLITICAL SCIENCE CLASS 7 BROOKLYN COLLEGE-CUNY SHANG E. HA Leon-Guerrero and Frankfort-Nachmias, Essentials of Statistics for.
Computer modelling ecosystem processes and change Lesson 8 Presentation 1.
Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.
POSC 202A: Lecture 1 Introductions Syllabus R Homework #1: Get R installed on your laptop; read chapters 1-2 in Daalgard, 1 in Zuur, See syllabus for Moore.
1 Doing Statistics for Business Doing Statistics for Business Data, Inference, and Decision Making Chapter 8 Hypothesis Testing : An Introduction.
Sampling Distributions and Hypothesis Testing. 2 Major Points An example An example Sampling distribution Sampling distribution Hypothesis testing Hypothesis.
Chapter 8 Introduction to Hypothesis Testing
1/2555 สมศักดิ์ ศิวดำรงพงศ์
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Hypothesis Testing: One Sample Cases. Outline: – The logic of hypothesis testing – The Five-Step Model – Hypothesis testing for single sample means (z.
Copyright © 2012 by Nelson Education Limited. Chapter 7 Hypothesis Testing I: The One-Sample Case 7-1.
Instructor Resource Chapter 5 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
Basic Statistical Concepts  M. Burgman & J. Carey 2002.
Population Viability Analysis 4 Seeks relationship between population size and probability of extinction –does not need to calculate MVP –concerned more.
Integrated Risk Management Charles Yoe, PhD Institute for Water Resources 2009.
6/3/2016 SCIENTIFIC METHOD PROCESSES OF SCIENTIFIC INQUIRY.
STRATEGIC ENVIRONMENTAL ASSESSMENT METHODOLOGY AND TECHNIQUES.
Welcome to Biology Mrs. Webster Room 243. List the steps of the scientific method. List characteristics of life. What is the difference between growth.
Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.
Sample Size Considerations for Answering Quantitative Research Questions Lunch & Learn May 15, 2013 M Boyle.
1 …continued… Part III. Performing the Research 3 Initial Research 4Research Approaches 5 Hypotheses 6 Data Collection 7 Data Analysis.
Chapter 9 Three Tests of Significance Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
SE 361 Lecture-03. Science is defined as: a department of systematized knowledge as an object of study; knowledge or a system of knowledge covering.
Ch 10 – Intro To Inference 10.1: Estimating with Confidence 10.2 Tests of Significance 10.3 Making Sense of Statistical Significance 10.4 Inference as.
Uncertainty Management in Rule-based Expert Systems
Issues concerning the interpretation of statistical significance tests.
Scientific Method Probability and Significance Probability Q: What does ‘probability’ mean? A: The likelihood that something will happen Probability.
Populations III: evidence, uncertainty, and decisions Bio 415/615.
1 CHAPTER 4 CHAPTER 4 WHAT IS A CONFIDENCE INTERVAL? WHAT IS A CONFIDENCE INTERVAL? confidence interval A confidence interval estimates a population parameter.
URBDP 591 I Lecture 4: Research Question Objectives How do we define a research question? What is a testable hypothesis? How do we test an hypothesis?
Sampling and Statistical Analysis for Decision Making A. A. Elimam College of Business San Francisco State University.
Chapter 8: Introduction to Hypothesis Testing. Hypothesis Testing A hypothesis test is a statistical method that uses sample data to evaluate a hypothesis.
Chapter 13 Understanding research results: statistical inference.
BHS Methods in Behavioral Sciences I May 9, 2003 Chapter 6 and 7 (Ray) Control: The Keystone of the Experimental Method.
Hypothesis Testing. Statistical Inference – dealing with parameter and model uncertainty  Confidence Intervals (credible intervals)  Hypothesis Tests.
Hypothesis Tests for 1-Proportion Presentation 9.
Judith Floor, 1 July 2016 Which cumulative effects? Effect assessments at science-policy boundaries.
Unit 5: Hypothesis Testing
Understanding Results
Null Hypothesis Testing
Setting significance levels at the correct level
Chapter 9: Hypothesis Tests Based on a Single Sample
Significance Tests: The Basics
POSC 202A: Lecture 1 Introductions Syllabus R
Sample Mean Compared to a Given Population Mean
Sample Mean Compared to a Given Population Mean
Psych 231: Research Methods in Psychology
BHS Methods in Behavioral Sciences I
The end of statistical significance
Presentation transcript:

Uncertainty and Decision Making 4 Presence of uncertainty is one of the most significant characteristics of environmental management decisions –Statistical errors and burden of proof (NRC chap. 8, 9) –Assessing threat and conservation priorities (Todd and Burgman 1998) –Managing Kirtland’s warblers in the face of environmental uncertainty (Marshall et al. 1998) 4 Adaptive Management is one way to increase certainty over time

Uncertainty (Todd and Burgman 1998) 4 Statistical uncertainty 4 Subjective judgement 4 Systematic error 4 Incomplete knowledge 4 Temporal variation 4 Inherent stochasticity 4 MOST CONSERVATION DECISIONS IGNORE IT

Statistical Uncertainty 4 Type I error: probability of rejecting Ho when Ho is actually true –scientist’s set this low so as to rarely incorrectly reject hypotheses and therefore slow or confuse the progress of science (  =0.05) 4 Type II error: probability of not rejecting the Ho when it is actually false –usually high because high precision (large sample size) is needed to reduce it and as type I error is reduced type II error increases

Power---the tradeoff between Type I and Type II error 4 Power = 1-  (  = probability of type II error) –probability of correctly rejecting the Ho –increases with increasing Type I error –increases with increasing precision (N)

Trading Off Type I and Type II Error in Biological Terms (Noss 1992) 4 Type I Error –Reject true Ho –Claim an effect when none exists –Protect more species than necessary –Lose scientific credibility –Increase socioeconomic costs more than necessary 4 Type II error –Accept false Ho –Claim no effect when one exists –Protect species less than necessary may loose species –Lose practical and scientific credibility –Permit activities that should not have been approved

Burden of Proof 4 Who has to demonstrate convincingly that a conservation action is needed? –Minimize type I error means burden of proof is on the party trying to conserve a species cost of incorrectly concluding there is a problem (Type I) is greater than cost of incorrectly concluding there is not a problem (Type II) –Poor Information on status of species reduces power and increases Type II error burden of proof is again on the conservationist

Do We Just Minimize Type II Error? 4 Simple shifting of burden of proof from conservationists to resource users –Unnecessary socioeconomic hardship? 4 Need to explicitly consider what shifting burden of proof means for conservation and then argue the prudent route 4 Precautionary Principle –better to err on side of caution when effect is not reversible EXTINCTION

Formal Evaluation of Uncertainty 4 Kirtland’s warblers (Marshall et al. 1998) 4 Want to minimize costs of management (maximize timber harvest return) while keeping P(N<S)<  –N is pop size at end of management –S is population size the manager wants (target) –1-  = “margin of safety” recognizes that management is not certain –probability quantifies our uncertainty of hitting S

Margin of Safety 4 If we want to only undershoot our target 5% of the time then we have a 95% “margin of safety” 4 Increasing the margin of safety, means reducing the chances of undershooting our target –This costs money! –For Kirtlands’ warblers it means harvest less timber so you are sure you wont’t end up with too few warblers

Costs of “Safety” 4 Safety costs because of uncertainty: –we are not sure what warbler population will do without management (environmental and demographic stochasiticity) –we are not sure what the forest will do (growth models) –we are not sure how warblers will respond to forest management (habitat suitability models)

Quantifying the Costs 4 Increasing from a 90% to 99% margin of safety doubles the costs (reduces harvest) 4 Less certainty means you have to be especially conservative in resource management which costs more (less resource removed) 4 Irreversible effects (extinction) command greater safety margins

Including Uncertainty (Todd and Burgman 1998) 4 Rather than using a simple point estimate for a variable, you can encode variation in the variable and combine variation among several variables using FUZZY SET THEORY 4 Estimate of population size –point is mean of 550 –fuzzy set used to calculate likelihood of membership in population of ,000 cumulative probability distribution using SE

Fuzzy Sets Point = 550 Point= 70 Fuzzy Sets define a range of likely values rather than just a point estimate

Degree of Membership 4 Can be from a cumulative probability distribution –Population Size SE=300 4 Can be assigned by expert opinion –Degree of “belief”-- -Range Size could be up to 900km 2 Population Size Cumulative Distribution

Most Likely given uncertainty Combination of Fuzzy Sets 4 Can take unions and intersections just like with crisp sets 4 Intersection gives degree of membership in both outcomes Point Estimate

Adaptive Management Recognizes That Managers Need to Work Before Mechanisms are Understood Relevant Spatial and Temporal Scale Hypothetico- deductive Methods Long-term Research Validation via Monitoring Increased Manager- Researcher Partnerships Solutions for Many of Wildlife Science’s Current Shortcomings

Benefits and Compromises of Adaptive Management Management Research Increase Area for Humans and Wildlife Value Hypothesis Development Maximize Wildlife Population Viability and Urban Development Compromise Short-term Performance by Implementing Some Poor Alternatives Learn How to Provide Habitat Effectively and Efficiently Test Alternative Hypotheses Compromise Statistical Rigor But Gain Scale Sensitivity and Relevance

Summary 4 Uncertainty is a certainty 4 We usually deal with it by minimizing type I error 4 Need to lay out the implications to conservation of type I versus type II error 4 May be able to incorporate uncertainty in the decision making process by modeling stochasticity (PVAs and the warbler example) or combining information with fuzzy set statistics 4 Adaptive Management may allow refinement of management techniques as uncertainty is reduced

References 4 Marshall, E., Haight, R. and F. R. Homans Incorporating environmental uncertainty into species management decisions: Kirtland’s warbler habitat management as a case study. Cons. Biol. 12: Todd, C.R. and M. A. Burgman Assessment of threat and conservation priorities under realistic levels of uncertainty and reliability. Cons. Biol. 12: Noss, R. F Biodiversity: many scales and many concerns. Pp in Kerner, H. F. (ed.) Proceedings of the symposium on biodiversity of northwestern california.