Stat 112: Notes 2 This class: Start Section 3.3. Thursday’s class: Finish Section 3.3. I will e-mail and post on the web site the first homework tonight.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Chapter 12 Inference for Linear Regression
Class 4: Tues., Sept. 21 External/Internal Reliability Clarification Regression Analysis Examples: –Appropriate Dating Ages –Father’s and son’s heights.
Chapter 27 Inferences for Regression This is just for one sample We want to talk about the relation between waist size and %body fat for the complete population.
Regression Inferential Methods
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
Linear regression models
Objectives (BPS chapter 24)
CHAPTER 3 ECONOMETRICS x x x x x Chapter 2: Estimating the parameters of a linear regression model. Y i = b 1 + b 2 X i + e i Using OLS Chapter 3: Testing.
Confidence intervals. Population mean Assumption: sample from normal distribution.
Class 5: Thurs., Sep. 23 Example of using regression to make predictions and understand the likely errors in the predictions: salaries of teachers and.
The Simple Regression Model
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 13 Introduction to Linear Regression and Correlation Analysis.
Stat 112 – Notes 3 Homework 1 is due at the beginning of class next Thursday.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Lecture 19 Simple linear regression (Review, 18.5, 18.8)
Chapter 12 Section 1 Inference for Linear Regression.
Simple Linear Regression Analysis
Correlation & Regression
Regression and Correlation Methods Judy Zhong Ph.D.
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Inference for regression - Simple linear regression
Hypothesis Testing in Linear Regression Analysis
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Ch4 Describing Relationships Between Variables. Pressure.
+ Chapter 12: Inference for Regression Inference for Linear Regression.
Regression. Height Weight How much would an adult female weigh if she were 5 feet tall? She could weigh varying amounts – in other words, there is a distribution.
Regression. Height Weight Suppose you took many samples of the same size from this population & calculated the LSRL for each. Using the slope from each.
Random Regressors and Moment Based Estimation Prepared by Vera Tabakova, East Carolina University.
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
Ch4 Describing Relationships Between Variables. Section 4.1: Fitting a Line by Least Squares Often we want to fit a straight line to data. For example.
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
Regression with Inference Notes: Page 231. Height Weight Suppose you took many samples of the same size from this population & calculated the LSRL for.
Inference for Regression Section Starter The Goodwill second-hand stores did a survey of their customers in Walnut Creek and Oakland. Among.
Lecture 8 Simple Linear Regression (cont.). Section Objectives: Statistical model for linear regression Data for simple linear regression Estimation.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
Stat 112: Notes 2 Today’s class: Section 3.3. –Full description of simple linear regression model. –Checking the assumptions of the simple linear regression.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Regression. Height Weight How much would an adult female weigh if she were 5 feet tall? She could weigh varying amounts – in other words, there is a distribution.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
CLASSICAL NORMAL LINEAR REGRESSION MODEL (CNLRM )
Section Parameter v. Statistic 2 Example 3.
The “Big Picture” (from Heath 1995). Simple Linear Regression.
STA302/1001 week 11 Regression Models - Introduction In regression models, two types of variables that are studied:  A dependent variable, Y, also called.
Chapter 4. The Normality Assumption: CLassical Normal Linear Regression Model (CNLRM)
Chapter 13 Lesson 13.2a Simple Linear Regression and Correlation: Inferential Methods 13.2: Inferences About the Slope of the Population Regression Line.
Inference for Regression
Regression.
AP Statistics Chapter 14 Section 1.
Regression.
Chapter 12 Regression.
Review of Hypothesis Testing
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
Regression.
Regression.
Regression.
Regression Chapter 8.
Regression.
When You See (This), You Think (That)
Simple Linear Regression
Regression.
Simple Linear Regression
Chapter 14 Inference for Regression
Regression and Correlation of Data
Sampling Distributions
Regression Models - Introduction
Presentation transcript:

Stat 112: Notes 2 This class: Start Section 3.3. Thursday’s class: Finish Section 3.3. I will and post on the web site the first homework tonight. It will be due next Thursday.

Father and Son’s Heights Francis Galton was interested in the relationship between –Y=son’s height –X=father’s height Galton surveyed 952 father-son pairs in 19 th Century England. Data is in Galton.JMP

Simple Linear Regression Model

Sample vs. Population We can view the data – -- as a sample from a population. Our goal is to learn about the relationship between X and Y in the population: –We don’t care about how father’s heights and son’s heights are related in the particular 952 men sampled but among all fathers and sons. –From Notes 1, we don’t care about the relationship between tracks counted and the density of deer for the particular sample, but the relationship among the population of all tracks; this enables to predict in the future the density of deer from the number of tracks counted.

Simple Linear Regression Model

Checking the Assumptions

Residual Plot

Checking Linearity Assumption

Violation of Linearity

Checking Constant Variance

Checking Normality

Inferences

Sampling Distribution of b 0,b 1 Utopia.JMP contains simulations of pairs and from a simple linear regression model with Notice the difference in the estimated coefficients from the y’s and y*’s. The sampling distribution of describes the probability distribution of the estimates over repeated samples from the simple linear regression model with fixed.

Utopia Linear Fit y = x Parameter Estimates TermEstimateStd Errort RatioProb>|t| Intercept <.0001 x <.0001 Linear Fit y* = x Parameter Estimates TermEstimateStd Errort RatioProb>|t| Intercept x <.0001

Sampling distributions Sampling distribution of – –Sampling distribution is normally distributed. Sampling distribution of – –Sampling distribution is normally distributed. –Even if the normality assumption fails and the errors e are not normal, the sampling distributions of are still approximately normal if n>30.

Properties of and as estimators of and Unbiased Estimators: Mean of the sampling distribution is equal to the population parameter being estimated. Consistent Estimators: As the sample size n increases, the probability that the estimator will become as close as you specify to the true parameter converges to 1. Minimum Variance Estimator: The variance of the estimator is smaller than the variance of any other linear unbiased estimator of, say