ST5219: BAYESIAN HIERARCHICAL MODELLING LECTURE 2.2 Priors, Normal Models, Computing Posteriors.

Slides:



Advertisements
Similar presentations
Model checks for complex hierarchical models Alex Lewin and Sylvia Richardson Imperial College Centre for Biostatistics.
Advertisements

Introduction to Monte Carlo Markov chain (MCMC) methods
Week 91 Example A device containing two key components fails when and only when both components fail. The lifetime, T 1 and T 2, of these components are.
There are two statistical tests for mean: 1) z test – Used for large samples (n ≥ 30) 1) t test – Used for small samples (n < 30)
May 18, 2004CS WPI1 CS 562 Advanced SW Engineering Lecture #6 Tuesday, May 18, 2004.
M.I. Jaime Alfonso Reyes ´Cortés.  The basic task for any probabilistic inference system is to compute the posterior probability distribution for a set.
Assuming normally distributed data! Naïve Bayes Classifier.
STAT 104. Section 8 Daniel Moon. Contents Feedback on HW #7 Critical Value Pooled, Unpooled, and Paired t-test F-test P-Value (Sample size is very large.
An Optimal Learning Approach to Finding an Outbreak of a Disease Warren Scott Warren Powell
Today Today: More on the Normal Distribution (section 6.1), begin Chapter 8 (8.1 and 8.2) Assignment: 5-R11, 5-R16, 6-3, 6-5, 8-2, 8-8 Recommended Questions:
Bayesian kriging Instead of estimating the parameters, we put a prior distribution on them, and update the distribution using the data. Model: Matrix with.
Computer vision: models, learning and inference Chapter 3 Common probability distributions.
Lesson Confidence Intervals about a Population Standard Deviation.
Priors, Normal Models, Computing Posteriors
Bayesian inference review Objective –estimate unknown parameter  based on observations y. Result is given by probability distribution. Bayesian inference.
St5219: Bayesian hierarchical modelling lecture 2.1.
Learning Theory Reza Shadmehr logistic regression, iterative re-weighted least squares.
Example: Bioassay experiment Problem statement –Observations: At each level of dose, 5 animals are tested, and number of death are observed.
Bayesian Multivariate Logistic Regression by Sean O’Brien and David Dunson (Biometrics, 2004 ) Presented by Lihan He ECE, Duke University May 16, 2008.
Ledolter & Hogg: Applied Statistics Section 6.2: Other Inferences in One-Factor Experiments (ANOVA, continued) 1.
Learning to Detect Events with Markov-Modulated Poisson Processes Ihler, Hutchins and Smyth (2007)
Bayesian Hierarchical Modeling for Longitudinal Frequency Data Joseph Jordan Advisor: John C. Kern II Department of Mathematics and Computer Science Duquesne.
Bayesian Prior and Posterior Study Guide for ES205 Yu-Chi Ho Jonathan T. Lee Nov. 24, 2000.
1 Bayesian Essentials Slides by Peter Rossi and David Madigan.
- 1 - Overall procedure of validation Calibration Validation Figure 12.4 Validation, calibration, and prediction (Oberkampf and Barone, 2004 ). Model accuracy.
MPS/MSc in StatisticsAdaptive & Bayesian - Lect 71 Lecture 7 Bayesian methods: a refresher 7.1 Principles of the Bayesian approach 7.2 The beta distribution.
- 1 - Matlab statistics fundamentals Normal distribution % basic functions mew=100; sig=10; x=90; normpdf(x,mew,sig) 1/sig/sqrt(2*pi)*exp(-(x-mew)^2/sig^2/2)
Fitting normal distribution: ML 1Computer vision: models, learning and inference. ©2011 Simon J.D. Prince.
Sparse Approximate Gaussian Processes. Outline Introduction to GPs Subset of Data Bayesian Committee Machine Subset of Regressors Sparse Pseudo GPs /
Outline Historical note about Bayes’ rule Bayesian updating for probability density functions –Salary offer estimate Coin trials example Reading material:
Computing with R & Bayesian Statistical Inference P548: Intro Bayesian Stats with Psych Applications Instructor: John Miyamoto 01/11/2016: Lecture 02-1.
Week 101 Test on Pairs of Means – Case I Suppose are iid independent of that are iid. Further, suppose that n 1 and n 2 are large or that are known. We.
Bayesian Estimation and Confidence Intervals Lecture XXII.
Bayesian Inference: Multiple Parameters
Section 8.2: The Sampling Distribution of a Sample Mean
Central Limit Theorem-CLT
Standard Errors Beside reporting a value of a point estimate we should consider some indication of its precision. For this we usually quote standard error.
Normal Distribution and Parameter Estimation
Commutative Property of Addition
Welcome to Week 03 Thurs MAT135 Statistics
Statistics Chapter 7 Review.
Chapter Six Normal Curves and Sampling Probability Distributions
Analyzing Redistribution Matrix with Wavelet
From: Statistics for optimal point prediction in natural images
Hypothesis Tests for a Population Mean in Practice
CI for μ When σ is Unknown
Predictive distributions
OVERVIEW OF BAYESIAN INFERENCE: PART 1
Location-Scale Normal Model
More about Posterior Distributions
Paul D. Sampson Peter Guttorp
INTRODUCTION TO Machine Learning
Sample Mean Distributions
Spot = $20 Strike = $18 Duration = 1 mo. 1 mo. Volatility = 5% x S=$18
Lecture Slides Elementary Statistics Twelfth Edition
STAT Z-Tests and Confidence Intervals for a
CHAPTER 6 Statistical Inference & Hypothesis Testing
CHAPTER 15 SUMMARY Chapter Specifics
Figure 4-1 (p.104) The statistical model for defining abnormal behavior. The distribution of behavior scores for the entire population is divided into.
Applications of the Normal Distribution
Empirical Rule Empirical rule only works for a bell-shaped distribution. That is, empirical rule cannot be applied to other distributions such as left-skewed,
Use the graph of the given normal distribution to identify μ and σ.
Lecture 10/24/ Tests of Significance
Section 9.3 Distribution of Sample Means
Two Sample Problem Sometimes we will be interested in comparing means in two independent populations (e.g. mean income for male and females). We consider.
CS639: Data Management for Data Science
SMOKERS NONSMOKERS Sample 1, size n1 Sample 2, size n2
Copyright © 2015 Elsevier Inc. All rights reserved.
Estimation – Posterior intervals
Classical regression review
Presentation transcript:

ST5219: BAYESIAN HIERARCHICAL MODELLING LECTURE 2.2 Priors, Normal Models, Computing Posteriors

The normal distribution Stupid name

The normal distribution Although data are normally not normal, the normal distribution is a popular model for data Assume normal distributions in:  paired t tests  two sample t tests  ANOVAs  regression  multiple regression ++? and use it as a limiting distribution for other models We’ll look at how to deal with a single sample now Next week: multiple normal data sets

A normal model Board work

Conjugate priors for a normal model The normal-scaled inverse χ² (NSIχ²) distribution is conjugate for the normal distribution If (μ,σ²)~ NSIχ²(μ 0, κ 0, ν 0, σ 0 ²) and x i ~N(μ,σ²) then (μ,σ²)|x ~ NSI χ²(μ n, κ n, ν n, σ n ²) Use geoR’s dinvchisq, rinvchisq for the inverse χ² bit To sample NSIχ²,  first draw σ² from Iχ²(μ k, κ k, ν k, σ k ²) and  then μ | σ² from N(μ k, σ²/κ k ) See Gelman et al (2003) Bayesian Data Analysis Chapman & Hall

In practice See computing posteriors (next section)