Regression assumptions Return to the paper Questions?

Slides:



Advertisements
Similar presentations
Forecasting Using the Simple Linear Regression Model and Correlation
Advertisements

13- 1 Chapter Thirteen McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc., All Rights Reserved.
Inference for Regression
Chapter 12 Simple Linear Regression
LECTURE 3 Introduction to Linear Regression and Correlation Analysis
Lecture 8 Relationships between Scale variables: Regression Analysis
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Chapter 12 Simple Regression
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 13-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
Lecture 24: Thurs. Dec. 4 Extra sum of squares F-tests (10.3) R-squared statistic (10.4.1) Residual plots (11.2) Influential observations (11.3,
Chapter Topics Types of Regression Models
Topic 3: Regression.
Quantitative Business Analysis for Decision Making Simple Linear Regression.
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Business Statistics - QBM117 Statistical inference for regression.
Simple Linear Regression Analysis
Statistical hypothesis testing – Inferential statistics II. Testing for associations.
A Clear Advantage: The Benefits of Transparency to Foreign Direct Investment By Elaine Shen and Mike Sliwinski.
Regression and Correlation Methods Judy Zhong Ph.D.
9 - 1 Intrinsically Linear Regression Chapter Introduction In Chapter 7 we discussed some deviations from the assumptions of the regression model.
Introduction to Linear Regression and Correlation Analysis
Inference for regression - Simple linear regression
Chapter 13: Inference in Regression
Chapter 11 Simple Regression
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Introduction to Linear Regression
MTH 161: Introduction To Statistics
EQT 373 Chapter 3 Simple Linear Regression. EQT 373 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value.
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
Copyright ©2011 Brooks/Cole, Cengage Learning Inference about Simple Regression Chapter 14 1.
1 Regression Analysis The contents in this chapter are from Chapters of the textbook. The cntry15.sav data will be used. The data collected 15 countries’
Lecture 10: Correlation and Regression Model.
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
Chapter 12: Correlation and Linear Regression 1.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Chapter 12 Simple Linear Regression n Simple Linear Regression Model n Least Squares Method n Coefficient of Determination n Model Assumptions n Testing.
Class 5 Multiple Regression CERAM February-March-April 2008 Lionel Nesta Observatoire Français des Conjonctures Economiques
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Quantitative Methods. Bivariate Regression (OLS) We’ll start with OLS regression. Stands for  Ordinary Least Squares Regression. Relatively basic multivariate.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
BUSINESS MATHEMATICS & STATISTICS. Module 6 Correlation ( Lecture 28-29) Line Fitting ( Lectures 30-31) Time Series and Exponential Smoothing ( Lectures.
Chapter 11: Linear Regression E370, Spring From Simple Regression to Multiple Regression.
Chapter 12: Correlation and Linear Regression 1.
Longitudinal Data & Mixed Effects Models Danielle J. Harvey UC Davis.
Chapter 13 Simple Linear Regression
A Clear Advantage: The Benefits of Transparency to Foreign Direct Investment By Elaine Shen and Mike Sliwinski.
Statistics for Managers using Microsoft Excel 3rd Edition
Multiple Regression Analysis: Estimation
Virtual COMSATS Inferential Statistics Lecture-26
(Residuals and
BIVARIATE REGRESSION AND CORRELATION
Diagnostics and Transformation for SLR
Regression Analysis Week 4.
Stats Club Marnie Brennan
CHAPTER 29: Multiple Regression*
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
Simple Linear Regression
Regression III.
Regression Assumptions
The Simple Regression Model
Simple Linear Regression
Longitudinal Data & Mixed Effects Models
Diagnostics and Transformation for SLR
Chapter Thirteen McGraw-Hill/Irwin
3 basic analytical tasks in bivariate (or multivariate) analyses:
Regression Assumptions
Linear Regression and Correlation
Presentation transcript:

Regression assumptions Return to the paper Questions? Lecture 11 Regression assumptions Return to the paper Questions?

What is error in a regression? Ideally error in this context is the combined influence on the dependent variable of a large number of excluded and hopefully irrelevant independent variables. Keep this in mind as we discuss the assumptions that must be met in conducting and interpreting regression results Those in bold are ones you should primarily concern yourself with in your project.

Basic OLS assumptions Dependent variable Independent variables Numeric at least at the interval level, continuous and unbounded. Not truncated (Not limited) Varies (non-zero variance) Normally distributed (or close to it) Independent variables Numeric at least at the interval level OR 1/0 Numeric variables normally distributed Vary (non-zero variance)

Basic OLS assumptions (cont.) The Independent variables are not (perfectly) correlated. The relationship between X and Y is expected to be linear (average error 0 everywhere) Independence of the errors No relevant independent variables have been excluded (including time and space) and No irrelevant independent variables have been included (You have more control over this why your model is important) The variables are measured without error, in particular bias (Hah!)

Basic OLS assumptions (cont.) Homoskedasticity Predicted values are as good (or bad) at all levels of the independent variable If variance is NOT constant across all values of the independent variables it is Heteroskadasticity.

Transforming variables E.g. For variables where there appears to be a logarithmic distribution of the data (e.g. population) logging the variables (=ln(X))* can make the relationship linear while preserving the interval relationships of the data. Often all variables are logged to assist in interpretation A one unit change in X results in a B change in Y A one percent change in X results in a B percent change in Y You can not take the natural log of zero, need to transform further. For more on interpretation see www.ats.ucla.edu/stat/spss/faq/spss_interpret_log.htm

N The more relevant observations (the bigger N) you have the more variation and the more powerful your results – if you just have ten countries and your model does not limit you, you likely want to add observations.

The paper Focus on presenting and describing the data that you think tells the story. KISS Use history and policy from other sources to put it in context. Use some of the methods from class to summarize data in text. E.g. “Exports of computers grew at an average annual rate of 5% in the 1990s. Despite a strong start this decade, hitting 11% growth in 2000, the sector’s exports fallen sharply and have averaged just 2% annually.”

Suggested format Introduction Trends and patterns in [Country’s] Trade States what the basic story is. Trends and patterns in [Country’s] Trade Present in simple terms how trade has changed over the past two decades. Be parsimonious. Discussion Provide the context for the data story such as key events or milestones in the story’s development. Conclusion