MSc Methods part XX: YY Dr. Mathias (Mat) Disney UCL Geography Office: 113, Pearson Building Tel: 7670 0592

Slides:



Advertisements
Similar presentations
Estimation, Variation and Uncertainty Simon French
Advertisements

Last Time (Sampling &) Estimation Confidence Intervals Started Hypothesis Testing.
Statistics review of basic probability and statistics.
NASSP Masters 5003F - Computational Astronomy Lecture 5: source detection. Test the null hypothesis (NH). –The NH says: let’s suppose there is no.
MSc Methods XX: YY Dr. Mathias (Mat) Disney UCL Geography Office: 113, Pearson Building Tel:
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 10: The Bayesian way to fit models Geoffrey Hinton.
Introduction to Statistics
1 Slides for the book: Probabilistic Robotics Authors: Sebastian Thrun Wolfram Burgard Dieter Fox Publisher: MIT Press, Web site for the book & more.
Presenter: Yufan Liu November 17th,
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
0 Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
G. Cowan 2011 CERN Summer Student Lectures on Statistics / Lecture 41 Introduction to Statistics − Day 4 Lecture 1 Probability Random variables, probability.
MSc Methods XX: YY Dr. Mathias (Mat) Disney UCL Geography Office: 113, Pearson Building Tel:
Some standard univariate probability distributions
© 2003 by Davi GeigerComputer Vision November 2003 L1.1 Tracking We are given a contour   with coordinates   ={x 1, x 2, …, x N } at the initial frame.
Probability Distributions and Frequentist Statistics “A single death is a tragedy, a million deaths is a statistic” Joseph Stalin.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 7 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination using shapes ATLAS Statistics Meeting CERN, 19 December, 2007 Glen Cowan.
Lecture II-2: Probability Review
Lecture 9: p-value functions and intro to Bayesian thinking Matthew Fox Advanced Epidemiology.
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
Distributions Dr. Omar Al Jadaan Assistant Professor – Computer Science & Mathematics.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
880.P20 Winter 2006 Richard Kass 1 Confidence Intervals and Upper Limits Confidence intervals (CI) are related to confidence limits (CL). To calculate.
Statistical Decision Theory
Modeling and Simulation CS 313
Distributions Normal distribution Binomial distribution Poisson distribution Chi-square distribution Frequency distribution
Noise & Uncertainty ASTR 3010 Lecture 7 Chapter 2.
Individual values of X Frequency How many individuals   Distribution of a population.
Estimating parameters in a statistical model Likelihood and Maximum likelihood estimation Bayesian point estimates Maximum a posteriori point.
Theory of Probability Statistics for Business and Economics.
R. Kass/W03P416/Lecture 7 1 Lecture 7 Some Advanced Topics using Propagation of Errors and Least Squares Fitting Error on the mean (review from Lecture.
GEOGG121: Methods Introduction to Bayesian analysis Dr. Mathias (Mat) Disney UCL Geography Office: 113, Pearson Building Tel:
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 20 Testing Hypotheses About Proportions.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
G. Cowan Lectures on Statistical Data Analysis Lecture 1 page 1 Lectures on Statistical Data Analysis London Postgraduate Lectures on Particle Physics;
The Triangle of Statistical Inference: Likelihoood Data Scientific Model Probability Model Inference.
Bayesian vs. frequentist inference frequentist: 1) Deductive hypothesis testing of Popper--ruling out alternative explanations Falsification: can prove.
Lecture 2 Review Probabilities Probability Distributions Normal probability distributions Sampling distributions and estimation.
Economics 173 Business Statistics Lecture 4 Fall, 2001 Professor J. Petry
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
Botkin & Keller Environmental Science 5/e Chapter 2 Science as a Way of Knowing.
Uniovi1 Some statistics books, papers, etc. G. Cowan, Statistical Data Analysis, Clarendon, Oxford, 1998 see also R.J. Barlow,
Hypothesis Testing. “Not Guilty” In criminal proceedings in U.S. courts the defendant is presumed innocent until proven guilty and the prosecutor must.
2001: Dissertation Process Measurement in data-poor situations Dr. Mathias (Mat) Disney UCL Geography Office: 113 Pearson Building Tel:
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
G. Cowan Lectures on Statistical Data Analysis Lecture 8 page 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem 2Random variables and.
1 Introduction to Statistics − Day 3 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Brief catalogue of probability densities.
1 6. Mean, Variance, Moments and Characteristic Functions For a r.v X, its p.d.f represents complete information about it, and for any Borel set B on the.
G. Cowan Lectures on Statistical Data Analysis Lecture 4 page 1 Lecture 4 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
Stochastic Processes1 CPSC : Stochastic Processes Instructor: Anirban Mahanti Reference Book “Computer Systems Performance.
Chapter 31Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012 John Wiley & Sons, Inc.
ELEC 303 – Random Signals Lecture 17 – Hypothesis testing 2 Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 2, 2009.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
R. Kass/Sp07P416/Lecture 71 More on Least Squares Fit (LSQF) In Lec 5, we discussed how we can fit our data points to a linear function (straight line)
MSc Methods part II: Bayesian analysis Dr. Mathias (Mat) Disney UCL Geography Office: 113, Pearson Building Tel:
Theoretical distributions: the Normal distribution.
MECH 373 Instrumentation and Measurements
Physics 114: Lecture 13 Probability Tests & Linear Fitting
Probability and Statistics for Particle Physics
PSY 626: Bayesian Statistics for Psychological Science
Continuous Random Variables: Basics
Presentation transcript:

MSc Methods part XX: YY Dr. Mathias (Mat) Disney UCL Geography Office: 113, Pearson Building Tel:

Two parameter estimation –Some stuff Uncertainty & linear approximations –parameter estimation, uncertainty –Practical – basic Bayesian estimation Linear Models –parameter estimation, uncertainty –Practical – basic Bayesian estimation Lecture outline

Reading and browsing Bayesian methods, data analysis Gauch, H., 2002, Scientific Method in Practice, CUP. Sivia, D. S., with Skilling, J. (2008) Data Analysis, 2 nd ed., OUP, Oxford. Computational Numerical Methods in C (XXXX) Flake, W. G. (2000) Computational Beauty of Nature, MIT Press. Gershenfeld, N. (2002) The Nature of Mathematical Modelling,, CUP. Wainwright, J. and Mulligan, M. (2004) (eds) Environmental Modelling: Finding Simplicity in Complexity, John Wiley and Sons. Mathematical texts, inverse methods Tarantola (XXXX) Kalman filters Welch and Bishop Maybeck

Reading and browsing Papers, articles, links P-values Siegfried, T. (2010) “Odds are it’s wrong”, Science News, 107(7), Ioannidis, J. P. A. (2005) Why most published research findings are false, PLoS Medicine, Bayes Hill, R. (2004) Multiple sudden infant deaths – coincidence or beyond coincidence, Pediatric and Perinatal Epidemiology, 18, ( Error analysis

Example: signal in the presence of background noise Very common problem: e.g. peak of lidar return from forest canopy? Presence of a star against a background? Transitioning planet? Parameter estimation continued A B x 0 See p in Sivia & Skilling

Data are e.g. photon counts in a particular channel, so expect count in k th chanel N k to be where S, B are signal and background Assume peak is Gaussian (for now), width w, centered on x o so ideal datum D k then given by Where n 0 is constant (  integration time). Unlike N k, D k not a whole no., so actual datum some integer close to D k Poisson distribution is pdf which represents this property i.e. Parameter estimation continued

Poisson: describes the p of N events occurring over some fixed time interval if events occur at a known rate and independently of the time of the previous event If expected number over a given interval is D, then prob. of exactly N events Aside: Poisson distribution Widely used in discrete counting experiments Particularly cases where large number of outcomes, each of which is rare (law of rare events) e.g. Nuclear decay No. of calls arriving at a call centre per minute – large number arriving BUT rare from POV of general population….

Data are e.g. photon counts in a particular channel, so expect count in k th chanel N k to be where S, B are signal and background Assume peak is Gaussian (for now), width w, centered on x o so ideal datum D k then given by Where n 0 is constant (  integration time). Unlike N k, D k not a whole no., so actual datum some integer close to D k Poisson distribution is pdf which represents this property i.e. Parameter estimation continued

If P(innocent|match) ~ 1: then P(match|innocent) ~ 1:1000 Other priors? Strong local ethnic identity? Many common ancestors within yrs (isolated rural areas maybe)? P(match|innocent) >> 1:1000, maybe 1:100 Says nothing about innocence, but a jury must consider whether the DNA evidence establishes guilt beyond reasonable doubt Common errors: reversed conditional Stewart, I. (1996) The Interrogator’s Fallacy, Sci. Am., 275(3),