REGRESSION REVISITED. PATTERNS IN SCATTER PLOTS OR LINE GRAPHS Pattern Pattern Strength Strength Regression Line Regression Line Linear Linear y = mx.

Slides:



Advertisements
Similar presentations
Correlation and regression
Advertisements

Chap 12-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 12 Simple Regression Statistics for Business and Economics 6.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Data Analysis: Bivariate Correlation and Regression CHAPTER sixteen.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Bivariate Correlation and Regression CHAPTER Thirteen.
Simple Regression Model
Learning Objectives 1 Copyright © 2002 South-Western/Thomson Learning Data Analysis: Bivariate Correlation and Regression CHAPTER sixteen.
Causal Forecasting by Gordon Lloyd. What will be covered? What is forecasting? What is forecasting? Methods of forecasting Methods of forecasting What.
Linear Regression Using Excel 2010 Linear Regression Using Excel ® 2010 Managerial Accounting Prepared by Diane Tanner University of North Florida Chapter.
LECTURE 3 Introduction to Linear Regression and Correlation Analysis
Chapter 13 Multiple Regression
Chapter 14 Introduction to Linear Regression and Correlation Analysis
Chapter 12 Simple Regression
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 13-1 Chapter 13 Simple Linear Regression Basic Business Statistics 11 th Edition.
Chapter 12 Multiple Regression
1 An example. 2 AirlinePercentage on time Complaints Southwest Continental Northwest US Airways United American
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 13-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
Linear Regression Example Data
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Business Statistics: Communicating with Numbers By Sanjiv Jaggia.
Chapter 14 Introduction to Linear Regression and Correlation Analysis
Chapter 6 (cont.) Regression Estimation. Simple Linear Regression: review of least squares procedure 2.
Chapter 13 Simple Linear Regression
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 13-1 Chapter 13 Introduction to Multiple Regression Statistics for Managers.
Quantitative Demand Analysis
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.
Extending that Line into the Future St. Louis CMG February 12, 2008 Wayne Bell – UniGroup, Inc.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Measures of relationship Dr. Omar Al Jadaan. Agenda Correlation – Need – meaning, simple linear regression – analysis – prediction.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Chapter 14 Introduction to Multiple Regression
You want to examine the linear dependency of the annual sales of produce stores on their size in square footage. Sample data for seven stores were obtained.
Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc. Chap 12-1 Correlation and Regression.
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
Applied Quantitative Analysis and Practices LECTURE#22 By Dr. Osman Sadiq Paracha.
EQT 373 Chapter 3 Simple Linear Regression. EQT 373 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value.
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
GrowingKnowing.com © Correlation and Regression Correlation shows relationships between variables. This is important. All professionals want to.
Statistics for Business and Economics 8 th Edition Chapter 12 Multiple Regression Ch Copyright © 2013 Pearson Education, Inc. Publishing as Prentice.
Regression. Population Covariance and Correlation.
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
Multiple Regression BPS chapter 28 © 2006 W.H. Freeman and Company.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Chapter 16 Data Analysis: Testing for Associations.
Discussion of time series and panel models
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Simple Linear Regression In the previous lectures, we only focus on one random variable. In many applications, we often work with a pair of variables.
Lecture 10: Correlation and Regression Model.
Chapter Thirteen Copyright © 2006 John Wiley & Sons, Inc. Bivariate Correlation and Regression.
Applied Quantitative Analysis and Practices LECTURE#25 By Dr. Osman Sadiq Paracha.
Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 14-1 Chapter 14 Introduction to Multiple Regression Statistics for Managers using Microsoft.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice- Hall, Inc. Chap 14-1 Business Statistics: A Decision-Making Approach 6 th Edition.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 14-1 Chapter 14 Introduction to Multiple Regression Basic Business Statistics 10 th Edition.
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Houston, Texas FAT CITY, USA Gloria Lobo-Stratton Sharon Lovdahl Dennis Glendenning.
Statistics for Managers Using Microsoft® Excel 5th Edition
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
Real Estate Sales Forecasting Regression Model of Pueblo neighborhood North Elizabeth Data sources from Pueblo County Website.
Chapter 12 Simple Linear Regression.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 14-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
Regression Modeling Applications in Land use and Transport.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.
Samantha Bellah Adv. Stats Final Project Real Estate Forecasting Regression Model Market: Highland Park Neighborhood Data Sources: Zillow.com E:\PuebloRESales2014Q1Q2.xlsx.
Simple linear regression and correlation Regression analysis is the process of constructing a mathematical model or function that can be used to predict.
Construction Engineering 221 Probability and Statistics.
Conceptual Foundations © 2008 Pearson Education Australia Lecture slides for this course are based on teaching materials provided/referred by: (1) Statistics.
Chapter 12 Simple Regression Statistika.  Analisis regresi adalah analisis hubungan linear antar 2 variabel random yang mempunyai hub linear,  Variabel.
Copyright © 2010 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics & Business Strategy Chapter 3 Quantitative.
Presentation transcript:

REGRESSION REVISITED

PATTERNS IN SCATTER PLOTS OR LINE GRAPHS Pattern Pattern Strength Strength Regression Line Regression Line Linear Linear y = mx + b Quadratic Quadratic y = ax 2 + bx + c Negative linear - weak No relationship Positive linear - strong Curvilinear

MODEL EVALUATION MODEL EVALUATION We want to test and see if the overall regression model is “statistically significant” We want to test and see if the overall regression model is “statistically significant” Null: The model is not significant (no effect) Null: The model is not significant (no effect) Alternative: The model is significant (there is an effect) or not all model coefficients are zero. Alternative: The model is significant (there is an effect) or not all model coefficients are zero. Time (years)# of cedar trees in 1 acre plot % of the variation in the number of cedar trees is explained by this linear model. This is a measure of how good the model fits the data. It does not tell us if the overall model is statistically significant.

MODEL EVALUATION MODEL EVALUATION In excel: Data: Data Analysis: Regression In excel: Data: Data Analysis: Regression An F-test and associated significance value is used to test overall model significance. An F-test and associated significance value is used to test overall model significance. A t-test and associated p-value is used to test if individual coefficients are significantly different than zero or that variable significantly predicts the y values (response). A t-test and associated p-value is used to test if individual coefficients are significantly different than zero or that variable significantly predicts the y values (response). SUMMARY OUTPUT Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations13 ANOVA dfSSMSFSignificance F Regression Residual Total CoefficientsStandard Errort StatP-valueLower 95% Upper 95% Lower 95.0% Upper 95.0% Intercept X Variable Reject the null of p < your chosen significance level. Typically, 0.01 or 0.05

MODEL EVALUATION MODEL EVALUATION No linear relationship. No linear relationship. What about a quadratic relationship? What about a quadratic relationship? Coefficients are not easy to interpret like the slope = rate of change in the linear model. Coefficients are not easy to interpret like the slope = rate of change in the linear model. Model interpretation is that initially the number of cedar trees increase and then eventually the numbers fall off. Biological explanation is that cedar numbers grow quickly but eventually taller deciduous trees dominate the forest canopy and ultimately restrict their growth and decrease their numbers. Model interpretation is that initially the number of cedar trees increase and then eventually the numbers fall off. Biological explanation is that cedar numbers grow quickly but eventually taller deciduous trees dominate the forest canopy and ultimately restrict their growth and decrease their numbers. 89% of the variation in the number of cedar trees is explained by this quadratic model. This still doesn’t tell if the overall model is statistically significant.

MODEL EVALUATION MODEL EVALUATION In excel you have to manually form a column of x 2 values to use in the Data Analysis: Regression In excel you have to manually form a column of x 2 values to use in the Data Analysis: Regression X Variable 1 = x values X Variable 1 = x values X Variable 2 = x 2 values X Variable 2 = x 2 values SUMMARY OUTPUT Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations13 ANOVA dfSSMSFSignificance F Regression E-05 Residual Total CoefficientsStandard Errort StatP-valueLower 95%Upper 95% Lower 95.0% Upper 95.0% Intercept X Variable E X Variable E

REGRESSION RECAP REGRESSION RECAP Plot the data using either a line graph or scatter plot Plot the data using either a line graph or scatter plot Visually determine a pattern and strength of pattern Visually determine a pattern and strength of pattern Add either a linear or quadratic trendline Add either a linear or quadratic trendline Evaluate the model based upon Evaluate the model based upon R 2 for model fit R 2 for model fit F-test and individual t-test for model and variable significance. F-test and individual t-test for model and variable significance. Reject the null and conclude the model and/or variable(s) are significant if p < 0.05 or 0.01 Reject the null and conclude the model and/or variable(s) are significant if p < 0.05 or 0.01 If not a significant model, try a different model and evaluate that model If not a significant model, try a different model and evaluate that model Once you find a significant model, interpret the model or trend Once you find a significant model, interpret the model or trend Give possible biological explanations for the model or trend Give possible biological explanations for the model or trend