Once again about the science-policy interface. Open risk management: overview QRAQRA.

Slides:



Advertisements
Similar presentations
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Advertisements

Psychology 290 Special Topics Study Course: Advanced Meta-analysis April 7, 2014.
Uncertainty in Engineering The presence of uncertainty in engineering is unavoidable. Incomplete or insufficient data Design must rely on predictions or.
Intro to Bayesian Learning Exercise Solutions Ata Kaban The University of Birmingham 2005.
Short review of probabilistic concepts
Section 7.1 Hypothesis Testing: Hypothesis: Null Hypothesis (H 0 ): Alternative Hypothesis (H 1 ): a statistical analysis used to decide which of two competing.
Probability theory Much inspired by the presentation of Kren and Samuelsson.
Hypergeometric Random Variables. Sampling without replacement When sampling with replacement, each trial remains independent. For example,… If balls are.
A/Prof Geraint Lewis A/Prof Peter Tuthill
Short review of probabilistic concepts Probability theory plays very important role in statistics. This lecture will give the short review of basic concepts.
Visualizing Events Contingency Tables Tree Diagrams Ace Not Ace Total Red Black Total
I The meaning of chance Axiomatization. E Plurbus Unum.
Introduction to Bayesian statistics Three approaches to Probability  Axiomatic Probability by definition and properties  Relative Frequency Repeated.
Probability (cont.). Assigning Probabilities A probability is a value between 0 and 1 and is written either as a fraction or as a proportion. For the.
1 Basic Probability Statistics 515 Lecture Importance of Probability Modeling randomness and measuring uncertainty Describing the distributions.
Standard error of estimate & Confidence interval.
A Practical Course in Graphical Bayesian Modeling; Class 1 Eric-Jan Wagenmakers.
Bayesian Decision Theory Making Decisions Under uncertainty 1.
Introduction to Management Science
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION I Probability Theory Review.
11-1 Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Probability and Statistics Chapter 11.
Decision analysis and risk management: Introduction to course Jouni Tuomisto, THL.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
1 Reasoning Under Uncertainty Artificial Intelligence Chapter 9.
Bayesian vs. frequentist inference frequentist: 1) Deductive hypothesis testing of Popper--ruling out alternative explanations Falsification: can prove.
Uncertainty Uncertain Knowledge Probability Review Bayes’ Theorem Summary.
Bayesian statistics Probabilities for everything.
Week 21 Conditional Probability Idea – have performed a chance experiment but don’t know the outcome (ω), but have some partial information (event A) about.
Once again about the science-policy interface. Open risk management: overview QRAQRA.
Once again about the science-policy interface. Open risk management: overview QRAQRA.
Chapter 13 February 19, Acting Under Uncertainty Rational Decision – Depends on the relative importance of the goals and the likelihood of.
Not in FPP Bayesian Statistics. The Frequentist paradigm Defines probability as a long-run frequency independent, identical trials Looks at parameters.
Making sense of randomness
Bayesian Inference, Review 4/25/12 Frequentist inference Bayesian inference Review The Bayesian Heresy (pdf)pdf Professor Kari Lock Morgan Duke University.
Uncertainty ECE457 Applied Artificial Intelligence Spring 2007 Lecture #8.
2. Introduction to Probability. What is a Probability?
Ch15: Decision Theory & Bayesian Inference 15.1: INTRO: We are back to some theoretical statistics: 1.Decision Theory –Make decisions in the presence of.
Probability. Probability Probability is fundamental to scientific inference Probability is fundamental to scientific inference Deterministic vs. Probabilistic.
Week 21 Rules of Probability for all Corollary: The probability of the union of any two events A and B is Proof: … If then, Proof:
Univariate Gaussian Case (Cont.)
- 1 - Outline Introduction to the Bayesian theory –Bayesian Probability –Bayes’ Rule –Bayesian Inference –Historical Note Coin trials example Bayes rule.
Statistical NLP: Lecture 4 Mathematical Foundations I: Probability Theory (Ch2)
Introduction to probability theory Jouni Tuomisto THL.
Outline Historical note about Bayes’ rule Bayesian updating for probability density functions –Salary offer estimate Coin trials example Reading material:
ECE457 Applied Artificial Intelligence Fall 2007 Lecture #8
Probability and Statistics
CHAPTER 10 Comparing Two Populations or Groups
What is Probability? Quantification of uncertainty.
Quick Review Probability Theory
Quick Review Probability Theory
Psychology 202a Advanced Psychological Statistics
Basic Probability Theory
An introduction to Bayesian reasoning Learning from experience:
Probability Probability underlies statistical inference - the drawing of conclusions from a sample of data. If samples are drawn at random, their characteristics.
Statistical NLP: Lecture 4
CHAPTER 10 Comparing Two Populations or Groups
From Randomness to Probability
Wellcome Trust Centre for Neuroimaging
CS 594: Empirical Methods in HCC Introduction to Bayesian Analysis
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
CS639: Data Management for Data Science
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
ECE457 Applied Artificial Intelligence Spring 2008 Lecture #8
basic probability and bayes' rule
Presentation transcript:

Once again about the science-policy interface

Open risk management: overview QRAQRA

Human-human interface There are really interesting new interfaces for transmitting information from person to person: –Facebook: How are you? –Wikipedia: What is thing X? –Opasnet: What should we do? A universal interface for communication about decisions and decision support is urgently needed. When that problem is solved, the communication problem between science and policy is solved as well.  There is no need for a separate science-policy interface.

Introduction to probability theory Jouni Tuomisto THL

Probability of a red ball P(x|K) = R/N, –x=event that a red ball is picked –K=your knowledge about the situation

Probability of an event x If you are indifferent between decisions 1 and 2, then your probability of x is p=R/N. p 1-p Red x does not happen x happens White ball Decision 1 Red ball Decision 2 Prize 100 € 0 € 100 € 0 €

The meaning of uncertainty –Uncertainty is that which disappears when we become certain. –We become certain of a declarative sentence when (a) truth conditions exist and (b) the conditions for the value ‘true’ hold. –(Bedford and Cooke 2001) –Truth conditions: –It is possible to design a setting where it can be observed whether the truth conditions are met or not.

Different kinds of uncertainty –Aleatory (variability, irreducible) –Epistemic (reducible), actually the difference only depends on its purpose in a model. –Weights of individuals is aleatory if we are interested in each person, but epistemic if we are interested in a random person in the population. –Parameter (in a model): should be observable! –Model: several models can be treated as parameters in a meta-model

Different kinds of uncertainty: not really uncertainty –Ambiguity: not uncertainty but fuzziness of description –Volitional uncertainty: “The probability that I will clean up the basement next weekend.” –Uncertainties about own actions cannot be measured by probabilities.

What is probability? – 1. Frequentists talk about probabilities only when dealing with experiments that are random and well- defined. The probability of a random event denotes the relative frequency of occurrence of an experiment's outcome, when repeating the experiment. Frequentists consider probability to be the relative frequency "in the long run" of outcomes.[1] – 2. Bayesians, however, assign probabilities to any statement whatsoever, even when no random process is involved. Probability, for a Bayesian, is a way to represent an individual's degree of belief in a statement, or an objective degree of rational belief, given the evidence. –Source: Wikipedia

Significance and confidence Significance level: –The probability of some aspect of the data, given H is true. Probability: –Your probability of H, given data. Confidence: –Probability that the interval includes θ (θ is given). Probability: –Probability that θ is included in the interval (data is given).

Positions of Bayesian approach Statistics is the study of uncertainty. Uncertainty should be measured by probability. Data uncertainty is so measured, conditional on the parameters. Parameter uncertainty is similarly measured by probability. Inference is performed within the probability calculus, mainly by Bayesian rule.

Probability and conditional probabilities The totality of possible states of the world P(A) P(B)

Probability rules Rule 1 (convexity): –For all A and B, 0 ≤ P(A|B) ≤ 1 and P(A|A)=1. –Cromwell’s rule P(A|B)=1 if and only if A is a logical consequence of B. Rule 2 (addition): if A and B are exclusive, given C, –P(A U B|C) = P(A|C) + P(B|C). –P(A U B|C) = P(A|C) + P(B|C) – P(A ∩ B|C) if not exclusive. Rule 3 (multiplication): for all A, B, and C, –P(AB|C) = P(A|BC) P(B|C) Rule 4 (conglomerability): if {B n } is a partition, possibly infinite, of C and P(A|B n C)=k, the same value for all n, then P(A|C)=k.

Binomial distribution –You make n trials with success probability p. The number of successful trials k follows the binomial distribution. –Like drawing n balls (with replacement) from an urn and k being red. –P(n,k|p) = n!/k!/(n-k)! p k (1-p) (n-k)

Example –You draw randomly 3 balls from an urn with 40 red and 60 white balls. What is the probability distribution for the number of red balls?

Answer –P(n,k|p) = n!/k!/(n-k)! p k (1-p) (n-k) –0 red: 3!/0!/3! *0.4 0 *(1-0.4) 3-0 – = 1*1*0.6 3 = –1 red: 3!/1!/2! *0.4 1 *(1-0.4) 3-1 = –2 red: 3!/2!/2! *0.4 2 *(1-0.4) 3-2 = –3 red: 3!/3!/0! *0.4 3 *(1-0.4) 3-3 = 0.064

Binomial distribution (n=6) P(|p,n)

Binomial distribution: likelihoods P(k|,n)

Bayes’ theorem –P(θ|x) = P(x|θ) P(θ) / P(x) –Proof: –P(θ, x) = P(θ|x)P(x) = P(x|θ) P(θ) –P(x) is often difficult to determine, but it is independent of θ and thus a constant over θ. Therefore: –P(θ|x) ~ P(x|θ) P(θ) (proportionality)

Bayes with words Likelihood: P(x| θ) Prior: P(θ) Posterior: P(θ|x) Posterior ~ Prior*Likelihood

Getting rid of nuisance factors –P(θ,α|x) = P(x,α |θ) P(θ,α) / P(x,α) –P(θ|x) = ∫P(θ,α |x) dα