Populations III: evidence, uncertainty, and decisions Bio 415/615.

Slides:



Advertisements
Similar presentations
Bayes rule, priors and maximum a posteriori
Advertisements

Inferential Statistics and t - tests
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Statistics.  Statistically significant– When the P-value falls below the alpha level, we say that the tests is “statistically significant” at the alpha.
Estimation, Variation and Uncertainty Simon French
1 Hypothesis Testing Chapter 8 of Howell How do we know when we can generalize our research findings? External validity must be good must have statistical.
Jo Sweetland Research Occupational Therapist
Statistics: Purpose, Approach, Method. The Basic Approach The basic principle behind the use of statistical tests of significance can be stated as: Compare.
Statistical Issues in Research Planning and Evaluation
Statistical Decision Making
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 10: The Bayesian way to fit models Geoffrey Hinton.
Inferential Statistics & Hypothesis Testing
Hypotheses Testing. Example 1 We have tossed a coin 50 times and we got k = 19 heads Should we accept/reject the hypothesis that p = 0.5 (the coin is.
Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?
HYPOTHESIS TESTING Four Steps Statistical Significance Outcomes Sampling Distributions.
1 MF-852 Financial Econometrics Lecture 4 Probability Distributions and Intro. to Hypothesis Tests Roy J. Epstein Fall 2003.
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
Hypotheses Testing. Example 1 We have tossed a coin 50 times and we got k = 19 heads Should we accept/reject the hypothesis that p = 0.5 (the coin is.
Chapter Sampling Distributions and Hypothesis Testing.
Chapter 3 Hypothesis Testing. Curriculum Object Specified the problem based the form of hypothesis Student can arrange for hypothesis step Analyze a problem.
Uncertainty and Decision Making 4 Presence of uncertainty is one of the most significant characteristics of environmental management decisions –Statistical.
Richard M. Jacobs, OSA, Ph.D.
Lecture 9: p-value functions and intro to Bayesian thinking Matthew Fox Advanced Epidemiology.
Statistical Analysis. Purpose of Statistical Analysis Determines whether the results found in an experiment are meaningful. Answers the question: –Does.
AM Recitation 2/10/11.
Statistics 11 Hypothesis Testing Discover the relationships that exist between events/things Accomplished by: Asking questions Getting answers In accord.
Hypothesis Testing. Central Limit Theorem Hypotheses and statistics are dependent upon this theorem.
Hypothesis Testing – Introduction
Hypothesis testing is used to make decisions concerning the value of a parameter.
Fundamentals of Data Analysis Lecture 4 Testing of statistical hypotheses.
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
1 Statistical Inference Greg C Elvers. 2 Why Use Statistical Inference Whenever we collect data, we want our results to be true for the entire population.
Hypothesis Testing: One Sample Cases. Outline: – The logic of hypothesis testing – The Five-Step Model – Hypothesis testing for single sample means (z.
Individual values of X Frequency How many individuals   Distribution of a population.
10.2 Tests of Significance Use confidence intervals when the goal is to estimate the population parameter If the goal is to.
Hypothesis Testing Hypothesis Testing Topic 11. Hypothesis Testing Another way of looking at statistical inference in which we want to ask a question.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
Bayesian vs. frequentist inference frequentist: 1) Deductive hypothesis testing of Popper--ruling out alternative explanations Falsification: can prove.
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
Statistical Inference Statistical Inference involves estimating a population parameter (mean) from a sample that is taken from the population. Inference.
Lecture 18 Dustin Lueker.  A way of statistically testing a hypothesis by comparing the data to values predicted by the hypothesis ◦ Data that fall far.
Correlation Assume you have two measurements, x and y, on a set of objects, and would like to know if x and y are related. If they are directly related,
Not in FPP Bayesian Statistics. The Frequentist paradigm Defines probability as a long-run frequency independent, identical trials Looks at parameters.
Education 793 Class Notes Decisions, Error and Power Presentation 8.
Lecture 17 Dustin Lueker.  A way of statistically testing a hypothesis by comparing the data to values predicted by the hypothesis ◦ Data that fall far.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
Lecture: Forensic Evidence and Probability Characteristics of evidence Class characteristics Individual characteristics  features that place the item.
Welcome to MM570 Psychological Statistics
Introduction Suppose that a pharmaceutical company is concerned that the mean potency  of an antibiotic meet the minimum government potency standards.
Inferential Statistics Inferential statistics allow us to infer the characteristic(s) of a population from sample data Slightly different terms and symbols.
Hypothesis Testing. Central Limit Theorem Hypotheses and statistics are dependent upon this theorem.
1 Binomial Random Variables Lecture 5  Many experiments are like tossing a coin a fixed number of times and recording the up-face.  The two possible.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Results: How to interpret and report statistical findings Today’s agenda: 1)A bit about statistical inference, as it is commonly described in scientific.
Sampling Distributions Statistics Introduction Let’s assume that the IQ in the population has a mean (  ) of 100 and a standard deviation (  )
Chapter 8: Introduction to Hypothesis Testing. Hypothesis Testing A hypothesis test is a statistical method that uses sample data to evaluate a hypothesis.
Hypothesis Testing. Statistical Inference – dealing with parameter and model uncertainty  Confidence Intervals (credible intervals)  Hypothesis Tests.
Fundamentals of Data Analysis Lecture 4 Testing of statistical hypotheses pt.1.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. 1 FINAL EXAMINATION STUDY MATERIAL III A ADDITIONAL READING MATERIAL – INTRO STATS 3 RD EDITION.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Agenda n Probability n Sampling error n Hypothesis Testing n Significance level.
Hypothesis Testing: Hypotheses
Lecture: Forensic Evidence and Probability Characteristics of evidence
Bayes for Beginners Luca Chech and Jolanda Malamud
Testing Hypotheses I Lesson 9.
Mathematical Foundations of BME Reza Shadmehr
STA 291 Spring 2008 Lecture 17 Dustin Lueker.
Presentation transcript:

Populations III: evidence, uncertainty, and decisions Bio 415/615

Questions 1. What types of uncertainty are involved in conservation decisions? 2. How would you ask a conservation question for an event that involves chance? 3. Why do our estimates of uncertainty usually involve the normal distribution (bell curve)? 4. In statistics, what is a P value? 5. What is one way that ‘frequentist’ statistical methods differ from Bayesian methods?

Four threats to small populations: 1.Loss of genetic variability 2.Demographic variation 3.Environmental variation 4.Natural (rare) catastrophes

Variation in populations We tend to first ask about central tendencies: –what is the mean growth rate? But variation about the mean—variance— can often be more important in making conservations decisions than central tendencies. Stochasticity is unpredictable variation, and requires us to deal with probabilities.

Probabilistic outcomes In a deterministic world, we can ask: will the population go extinct if a road is built? In a stochastic world, we have to ask: what is the probability the population will go extinct if a road is built (and over what time period?)

Recall minimum viable population: Estimate of the # of individuals needed to perpetuate a population: 1) For a given length of time, e.g. for 100 or 1000 years 2) With a specified level of (un)certainty, e.g. 95% or 99%

Comparing outcomes (risk) Probabilities are often most useful when comparing the outcomes of two or more conservation decisions. –What is the probability Silene regia will decline to fewer than 10 individuals after 50 years of burning vs. non-burning? –How will the probability of extinction in 100 years of the Florida panther change if we translocate individuals from Texas?

Types of uncertainty Measurement uncertainty: variation in a parameter estimate due to precision and accuracy of measurement (sampling error) Model uncertainty: do we know how factors relate to one another, scale, etc? Do we know all the factors to include? Process uncertainty: can we know everything about nature? Climate?

Random events and the bell curve Karl Gauss ( ) German mathematician Formulated the normal (Gaussian) distribution

Random events and the bell curve Normal distribution is pervasive in stochastic models because it represents the expected error of random, independent events Dealing with uncertainty usually means figuring out the SHAPE (mean, variance) of a normal distribution.

Probability density function Area under the curve = 1 Tells probability of events between two limits

Frequentist methods (classical hypothesis testing) Involves comparing a null hypothesis (Ho) to an alternative hypothesis (Ha). Ho: The population is not declining. Ha: The population is declining. Frequentist methods involve significance tests involving the null hypothesis. What is the probability of the data, if the null hypothesis is true? = P value

P values If the P value is smaller than the significance level (e.g., α = 5%), then the null hypothesis is rejected. This is NOT the probability that the null hypothesis is true! In fact frequentist statistics cannot evaluate the probability of hypothesis (Ho OR Ha), only the probability of the data.

Coin flips: is it a fair coin? Ho: The coin is fair. Ha: The coin is not fair. Data: 14 heads out of 20 flips. If each flip is 50% chance of heads, this is a binomial trial. Under a normal distribution of 20 samples with a mean of 0.5, the probability of 14 heads is about 12%. So the coin is fair. BUT 15 heads is not fair! (P=0.04)

Why alpha of 5%? We will accept Ha even though it is false (Type I error, or false positive) 1 time out of 20. Why not more stringent criterion?

Why alpha of 5%? We will accept Ha even though it is false (Type I error, or false positive) 1 time out of 20. Why not more stringent criterion? If alpha 0.1%, we would probably ignore many Ha that are in fact correct (false negative, or Type II error) So why 5%? It’s an arbitrary compromise.

Why frequentist methods are losing ground to other methods Null hypotheses are usually not interesting. Decisions based on rejecting null hypotheses are often insensitive. Probabilities are usually misinterpreted as commenting on hypotheses, when actually they comment on the data. There is a greater risk of using inappropriate uncertainty estimates (e.g., often normality assumed).

Why frequentist methods are losing ground to other methods No straightforward way to combine different types of data, or pre-existing expert opinion. Often difficult to evaluate strength of different models (hypotheses). Poor integration with ‘the next step’— decision theory (again because probabilities are not associated with models, but data).

Bayesian methods Reverend Thomas Bayes ( ) Bayes’ theorem Describes both a method of statistical inference (quantifying probabilities of events) AND a statistical philosophy

Bayesian methods Reverend Thomas Bayes ( ) Bayes’ theorem Philosophy is based on putting probabilities on partial belief versus those established by frequencies. New information does not replace old information… it adjusts old information.

Diversion: baseball averages What can the first month of at bats tell you about the final batting average of a hitter?

Bayesian methods Bayes’ theorem The statistical method is based on calculating inverse probabilities. Example: Forward probability is establishing probability of tossing heads once you know something about the coin. Inverse probability is rather, what can you tell about the coin, given data on heads and tails?

Bayesian methods Posterior: Probability of a hypothesis, given new data We make decisions based on this Likelihood: Probability of the data, given a hypothesis of what uncertainty should look like (eg, bell curve) Prior: Our initial hypothesis before we got new data Normalizing constant

Medical example 1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies. A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer?

Medical example 1% of women at age forty who participate in routine screening have breast cancer. 80% of women with breast cancer will get positive mammographies. 9.6% of women without breast cancer will also get positive mammographies. A woman in this age group had a positive mammography in a routine screening. What is the probability that she actually has breast cancer? Most doctors say about 70-80%. Actual answer is 7.8% Why is our intuition wrong? Because it ignores the fact that very few women in the screened group actually have breast cancer, and the test doesn’t change that. That is, the prior is a very low probability.

Wade 2000 example 1. Priors and posteriors are probability density functions.

Wade 2000 example 2. When we have no initial expectation, we use a noniformative prior (usually a uniform distribution, or flat line).

Wade 2000 example 3. With a flat prior, our posterior distribution has the same properties as the likelihood, because it is based only on the current data. Here: mean of (Variance?)

Wade 2000 example 4. With more data (this time N=2000), our new estimate of population size somewhere in the middle, because we had prior information (data-based prior).

Why does statistical method matter in conservation? We are rarely concerned with yes/no answers Wade 2000: Compare Ho: population is not declining to Ha: population is declining. If there is much variation, Ho is difficult to reject. But we’re not just interested in Ho!

Wade 2000 Two populations: which to care about? Which one is declining? Which one is declining fast?

Final comment: the precautionary principle “Where there are threats of serious or irreversible environmental damage, lack of full scientific certainty should not be used as a reason for postponing measures to prevent environmental degradation.” (West German Env Legislation, late 1960s) Burden of proof on developers? Can you ‘prove’ lack of effect?