Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research The Classical Model and Hypothesis Testing.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Hypothesis Testing Steps in Hypothesis Testing:
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Objectives (BPS chapter 24)
Lecture 4 Econ 488. Ordinary Least Squares (OLS) Objective of OLS  Minimize the sum of squared residuals: where Remember that OLS is not the only possible.
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
© 2010 Pearson Prentice Hall. All rights reserved Least Squares Regression Models.
The Multiple Regression Model Prepared by Vera Tabakova, East Carolina University.
The Simple Linear Regression Model: Specification and Estimation
1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 2. Hypothesis Testing.
Chapter 10 Simple Regression.
CHAPTER 3 ECONOMETRICS x x x x x Chapter 2: Estimating the parameters of a linear regression model. Y i = b 1 + b 2 X i + e i Using OLS Chapter 3: Testing.
Statistics II: An Overview of Statistics. Outline for Statistics II Lecture: SPSS Syntax – Some examples. Normal Distribution Curve. Sampling Distribution.
Fundamentals of Hypothesis Testing. Identify the Population Assume the population mean TV sets is 3. (Null Hypothesis) REJECT Compute the Sample Mean.
4. Multiple Regression Analysis: Estimation -Most econometric regressions are motivated by a question -ie: Do Canadian Heritage commercials have a positive.
The Simple Regression Model
T-test.
Chapter Topics Types of Regression Models
Linear Regression and Correlation Analysis
Topics: Regression Simple Linear Regression: one dependent variable and one independent variable Multiple Regression: one dependent variable and two or.
Multivariate Regression Model y =    x1 +  x2 +  x3 +… +  The OLS estimates b 0,b 1,b 2, b 3.. …. are sample statistics used to estimate 
Inference about a Mean Part II
Topic 3: Regression.
Simple Linear Regression Analysis
Ordinary Least Squares
Multiple Linear Regression Analysis
Lecture 5 Correlation and Regression
Active Learning Lecture Slides
Regression and Correlation Methods Judy Zhong Ph.D.
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Chapter 11 Simple Regression
Hypothesis Testing in Linear Regression Analysis
Regression Analysis (2)
Understanding Multivariate Research Berry & Sanders.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
2-1 MGMG 522 : Session #2 Learning to Use Regression Analysis & The Classical Model (Ch. 3 & 4)
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
7.1 Multiple Regression More than one explanatory/independent variable This makes a slight change to the interpretation of the coefficients This changes.
Introduction to Linear Regression
B AD 6243: Applied Univariate Statistics Hypothesis Testing and the T-test Professor Laku Chidambaram Price College of Business University of Oklahoma.
Random Regressors and Moment Based Estimation Prepared by Vera Tabakova, East Carolina University.
1Spring 02 First Derivatives x y x y x y dy/dx = 0 dy/dx > 0dy/dx < 0.
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Ordinary Least Squares Regression.
Copyright © 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin The Two-Variable Model: Hypothesis Testing chapter seven.
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Statistical Principles and An Overview of.
3-1 MGMG 522 : Session #3 Hypothesis Testing (Ch. 5)
Lecture 10: Correlation and Regression Model.
Chapter 4 The Classical Model Copyright © 2011 Pearson Addison-Wesley. All rights reserved. Slides by Niels-Hugo Blunch Washington and Lee University.
Correlation & Regression Analysis
1 Econometrics (NA1031) Lecture 3 Interval Estimation and Hypothesis Testing.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Dependent (response) Variable Independent (control) Variable Random Error XY x1x1 y1y1 x2x2 y2y2 …… xnxn ynyn Raw data: Assumption:  i ‘s are independent.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Hypothesis Testing and Statistical Significance
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Lecturer: Ing. Martina Hanová, PhD..  How do we evaluate a model?  How do we know if the model we are using is good?  assumptions relate to the (population)
Chapter 4. The Normality Assumption: CLassical Normal Linear Regression Model (CNLRM)
STAT 312 Chapter 7 - Statistical Intervals Based on a Single Sample
Linear Regression and Correlation Analysis
Fundamentals of regression analysis
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
LESSON 24: INFERENCES USING REGRESSION
Statistics II: An Overview of Statistics
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research The Classical Model and Hypothesis Testing

Conducting Social Research Lecture Outline Review of uni-, bi-, and multi-variate statistics. Regression and Hypothesis testing. Sampling Distribution of Regression Coefficients. T-Tests. Confidence Intervals. Model Assumptions Properties of OLS Estimators.

Review of Statistics Univariate to Bivariate to Multivariate Conducting Social Research The observations make the mean.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The mean makes the variance.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The variance makes the standard deviation.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The means make the covariance.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The covariance makes the correlation.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The correlation makes the slope.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The slope makes the intercept.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The coefficients make the predicted.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The coefficients make the predictions.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The predictions make the explained sum of squared deviaitons.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate They also make the residuals.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The residuals make the residual sum of squared deviations.

Conducting Social Research Review of Statistics Univariate to Bivariate to Multivariate The RSS makes the total sum of squared deviations.

Conducting Social Research The Statistics in the

Conducting Social Research The Statistics in the

Conducting Social Research The Statistics in the

Conducting Social Research Housing Sales Data We have obtained a sample of 40 housing sales that took place somewhere in some year. The data contains two variables, price (in $’s) and size (total above grade finished area in feet 2 ).

Conducting Social Research Housing Sales Data

Conducting Social Research The Residual Standard Deviation

Conducting Social Research The Standard Error of a Bivariate Regression Coefficient (Slope)

Conducting Social Research The Standard Error of a Bivariate Regression Intercept

Conducting Social Research Hypothesis Testing From last week, what were some of our hypotheses concerning “Statistics Class Anxiety”? How would you state that hypothesis in terms of regression analysis? How would the null hypothesis be stated in terms of regression analysis?

Conducting Social Research Null Hypothesis The result that is not expected. Either rejected or not rejected but never accepted. General includes the equals sign in some form. Can estimate the probability of rejecting a null hypothesis that is true.

Conducting Social Research Alternative Hypothesis The result that is expected. Can never be accepted or proven but can be rejected. Can estimate the probability of accepting an alternative hypothesis that is false.

Conducting Social Research Types of Errors Not to be confused with residuals Type I: We reject a true null hypothesis. Type II: We fail to reject a false null hypothesis.

Conducting Social Research Americans find type II errors disturbing but not as horrifying as type I errors. A type I error means that not only has an innocent person been sent to jail but the truly guilty person has also gone free. In a sense, a type I error is twice as bad as a type II error. Needless to say, the American justice system puts a lot of emphasis on avoiding type I errors. This emphasis on avoiding type I errors, however, is not true in all cases where hypothesis testing is done. Justice System - Trial Defendan t Innocent Defendan t Guilty Reject Presumpti on of Innocenc e (Guilty Verdict) Type I Error Correct Fail to Reject Presumpti on of Innocenc e (Not Guilty Verdict) Correct Type II Error Statisti cs - Hypothesis Test Null Hypoth True Null Hypoth False Reject Null Hypothes is Type I Error Correct Fail to Reject Null Hypothes is Correc t Type II Error Defendant Innocent Defendant Guilty Reject Presumption of Innocence (Guilty Verdict) Type I Error Correct Fail to Reject Presumption of Innocence (Not Guilty Verdict) Correct Type II Error Hypothesis Testing Criminal Trial

Conducting Social Research Americans find type II errors disturbing but not as horrifying as type I errors. A type I error means that not only has an innocent person been sent to jail but the truly guilty person has also gone free. In a sense, a type I error is twice as bad as a type II error. Needless to say, the American justice system puts a lot of emphasis on avoiding type I errors. This emphasis on avoiding type I errors, however, is not true in all cases where hypothesis testing is done. Justice System - Trial Defendan t Innocent Defendan t Guilty Reject Presumpti on of Innocenc e (Guilty Verdict) Type I Error Correct Fail to Reject Presumpti on of Innocenc e (Not Guilty Verdict) Correct Type II Error Statisti cs - Hypothesis Test Null Hypoth True Null Hypoth False Reject Null Hypothes is Type I Error Correct Fail to Reject Null Hypothes is Correc t Type II Error Hypothesis Testing Criminal Trial

Conducting Social Research Americans find type II errors disturbing but not as horrifying as type I errors. A type I error means that not only has an innocent person been sent to jail but the truly guilty person has also gone free. In a sense, a type I error is twice as bad as a type II error. Needless to say, the American justice system puts a lot of emphasis on avoiding type I errors. This emphasis on avoiding type I errors, however, is not true in all cases where hypothesis testing is done. Justice System - Trial Defendan t Innocent Defendan t Guilty Reject Presumpti on of Innocenc e (Guilty Verdict) Type I Error Correct Fail to Reject Presumpti on of Innocenc e (Not Guilty Verdict) Correct Type II Error Statisti cs - Hypothesis Test Null Hypoth True Null Hypoth False Reject Null Hypothes is Type I Error Correct Fail to Reject Null Hypothes is Correc t Type II Error Hypothesis Testing Criminal Trial

Conducting Social Research Americans find type II errors disturbing but not as horrifying as type I errors. A type I error means that not only has an innocent person been sent to jail but the truly guilty person has also gone free. In a sense, a type I error is twice as bad as a type II error. Needless to say, the American justice system puts a lot of emphasis on avoiding type I errors. This emphasis on avoiding type I errors, however, is not true in all cases where hypothesis testing is done. Justice System - Trial Defendan t Innocent Defendan t Guilty Reject Presumpti on of Innocenc e (Guilty Verdict) Type I Error Correct Fail to Reject Presumpti on of Innocenc e (Not Guilty Verdict) Correct Type II Error Statisti cs - Hypothesis Test Null Hypoth True Null Hypoth False Reject Null Hypothes is Type I Error Correct Fail to Reject Null Hypothes is Correc t Type II Error Null Hypothesis True Null Hypothesis False Reject Null Hypothesis Type I Error Correct Fail to Reject Null Hypothesis Correct Type II Error Hypothesis Testing Research

Conducting Social Research Sampling Distribution of Regression Coefficients Given a sample of independent and identically distributed (iid) random variables with a finite population mean and a finite, nonzero standard deviation, as the sample size increases: the average of these observations will approach the population mean andthe average of these observations will approach the population mean and the probability distribution will approaches the normal distribution.the probability distribution will approaches the normal distribution. Are regression coefficients iid random variables with the requisite mean and standard deviation properties?

Conducting Social Research Sampling Distribution of Regression Coefficients What is the sampling distribution of regression coefficients?

Conducting Social Research Hypothesis Testing Two-tailed Test

Conducting Social Research Hypothesis Testing One-tailed Test

Conducting Social Research The “Significance” of Regression Coefficients (t-statistic)

Conducting Social Research Confidence Intervals of Regression Coefficients

Conducting Social Research The Regression Model F-statistic The Constrained Model F-statistic

Conducting Social Research Classical Assumptions of OLS I.The regression model is linear, is correctly specified, and has an additive error term. II.The error term has a zero population mean. III.All explanatory variables are uncorrelated with the error term. IV.Observations of the error term are uncorrelated with each other. V.The error term has a constant variance (homoskedasticity). VI.No explanatory variable is a perfect linear function of any other explanatory variable(s). VII.The error term is normally distributed.

Common Assumptions 1)Errors are independent, that is not correlated with X or the errors of other cases. 2)Errors have identical distributions (iid), with mean zero and equal variance (Homoscedasticity) for every value of X. 3)Errors are normally distributed. Conducting Social Research

The Gauss-Markov Theorem If the first six of the classical assumptions are met, the OLS estimators are the Best Linear Unbiased Estimators (BLUE): Minimum Variance (Best) - distribution around the true parameter values as narrow as possible.Minimum Variance (Best) - distribution around the true parameter values as narrow as possible. Unbiased-centered on the population values.Unbiased-centered on the population values. Consistent - As the sample size increases, the estimates converge toward the population value for each coefficient being estimated.Consistent - As the sample size increases, the estimates converge toward the population value for each coefficient being estimated. Normally Distributed.Normally Distributed.