Chi-squared distribution  2 N N = number of degrees of freedom Computed using incomplete gamma function: Moments of  2 distribution:

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
Chapter 7. Statistical Estimation and Sampling Distributions
Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.
Chap 8-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 8 Estimation: Single Population Statistics for Business and Economics.
Linear regression models
SOLVED EXAMPLES.
Point estimation, interval estimation
Chapter 6 Introduction to Sampling Distributions
Part 2b Parameter Estimation CSE717, FALL 2008 CUBS, Univ at Buffalo.
Chapter 7 Sampling and Sampling Distributions
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 6 Introduction to Sampling Distributions.
Estimation of parameters. Maximum likelihood What has happened was most likely.
Statistical inference form observational data Parameter estimation: Method of moments Use the data you have to calculate first and second moment To fit.
2. Point and interval estimation Introduction Properties of estimators Finite sample size Asymptotic properties Construction methods Method of moments.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Chapter 8 Estimation: Single Population
Chapter 7 Estimation: Single Population
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 7 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 7 Statistical Intervals Based on a Single Sample.
Some Continuous Probability Distributions Asmaa Yaseen.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Business Statistics, A First Course.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Chapter 7 Estimation: Single Population
Confidence Interval Estimation
Stat13-lecture 25 regression (continued, SE, t and chi-square) Simple linear regression model: Y=  0 +  1 X +  Assumption :  is normal with mean 0.
1 More about the Sampling Distribution of the Sample Mean and introduction to the t-distribution Presentation 3.
SECTION 6.4 Confidence Intervals for Variance and Standard Deviation Larson/Farber 4th ed 1.
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Moment Generating Functions
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
PROBABILITY (6MTCOAE205) Chapter 6 Estimation. Confidence Intervals Contents of this chapter: Confidence Intervals for the Population Mean, μ when Population.
Random Sampling, Point Estimation and Maximum Likelihood.
7.1 Multiple Regression More than one explanatory/independent variable This makes a slight change to the interpretation of the coefficients This changes.
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
Sample variance and sample error We learned recently how to determine the sample variance using the sample mean. How do we translate this to an unbiased.
STATISTICS INTERVAL ESTIMATION Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Mixture of Gaussians This is a probability distribution for random variables or N-D vectors such as… –intensity of an object in a gray scale image –color.
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
1 Standard error Estimated standard error,s,. 2 Example 1 While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power.
Statistics 300: Elementary Statistics Sections 7-2, 7-3, 7-4, 7-5.
Sampling and estimation Petter Mostad
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
The Simple Linear Regression Model. Estimators in Simple Linear Regression and.
Sampling Theory and Some Important Sampling Distributions.
Statistics Sampling Distributions and Point Estimation of Parameters Contents, figures, and exercises come from the textbook: Applied Statistics and Probability.
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
Week 21 Order Statistics The order statistics of a set of random variables X 1, X 2,…, X n are the same random variables arranged in increasing order.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
Chapter 5: The Basic Concepts of Statistics. 5.1 Population and Sample Definition 5.1 A population consists of the totality of the observations with which.
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
Statistics for Business and Economics 8 th Edition Chapter 7 Estimation: Single Population Copyright © 2013 Pearson Education, Inc. Publishing as Prentice.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
The “Big Picture” (from Heath 1995). Simple Linear Regression.
Chapter 4. Inference about Process Quality
Ch3: Model Building through Regression
Evgeniya Anatolievna Kolomak, Professor
Sampling Distributions
Parameter, Statistic and Random Samples
t distribution Suppose Z ~ N(0,1) independent of X ~ χ2(n). Then,
Estimating Population Variance
CONCEPTS OF ESTIMATION
STATISTICS INTERVAL ESTIMATION
Discrete Event Simulation - 4
Functions of Random variables
Confidence Intervals for Proportions and Variances
Fundamental Sampling Distributions and Data Descriptions
Presentation transcript:

Chi-squared distribution  2 N N = number of degrees of freedom Computed using incomplete gamma function: Moments of  2 distribution:

Constructing  2 from Gaussians - 1 Let G(0,1) be a normally-distributed random variable with zero mean and unit variance. For one degree of freedom: This means that: -a a G(0,1) 2121 a2a2 i.e. The  2 distribution with 1 degree of freedom is the same as the distribution of the square of a single normally distributed quantity.

Constructing  2 from Gaussians - 2 For two degrees of freedom: More generally: Example: Target practice! If X 1 and X 2 are normally distributed: i.e. R 2 is distributed as chi-squared with 2 d.o.f X1X1 X2X2

Data points with no error bars If the individual  i are not known, how do we estimate  for the parent distribution? Sample mean: Variance of parent distribution: By analogy, define sample variance: Is this an unbiased estimator, i.e. is =  2 ?

Estimating  2 – 1 Express sample variance as: Use algebra of random variables to determine: Expand: (Don’t worry, all will be revealed...)

Aside: what is Cov(X i,X)? X XiXi

Estimating  2 – 2 We now have For s 2 to be an unbiased estimator for  2, need A=1/(N-1):

If all observations X i have similar errors  : If we don’t know use X instead: In this case we have N-1 degrees of freedom. Recall that: (since =N) Degrees of freedom – 1

Degrees of freedom – 2 Suppose we have just one data point. In this case N=1 and so: Generalising, if we fit N data points with a function A involving M parameters  1...  M : The number of degrees of freedom is N-M.

Example: bias on CCD frames Suppose you want to know whether the zero- exposure (bias) signal of a CCD is uniform over the whole image. First step: determine s 2 (X) over a few sub- regions of the frame. Second step: determine X over the whole frame. Third step: Compute In this case we have fitted a function with one parameter (i.e. the constant X), so M=1 and we expect = N - 1 Use  2 N - 1 distribution to determine probability that  2 >  2 obs