Multiple Linear Regression Introduction. Multiple Regression One continuous Y, two or more X variables. X variables may be continuous or dichotomous k.

Slides:



Advertisements
Similar presentations
Topics: Multiple Regression Analysis (MRA)
Advertisements

Wednesday AM  Presentation of yesterday’s results  Associations  Correlation  Linear regression  Applications: reliability.
 Population multiple regression model  Data for multiple regression  Multiple linear regression model  Confidence intervals and significance tests.
CAAP Fall Report On Freshmen/Sophomores OIRA February 2007.
Acknowledgment: This project was developed in Stat 511 course – Fall Thanks to the College of Science for providing the data.Objective: For students.
Chapter 7 Using Multivariate Statistics P173 Multiple Regression Multiple Correlation – What’s the difference between regression and correlation? Validity.
Regression single and multiple. Overview Defined: A model for predicting one variable from other variable(s). Variables:IV(s) is continuous, DV is continuous.
Regression With Categorical Variables. Overview Regression with Categorical Predictors Logistic Regression.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
MULTIPLE REGRESSION. OVERVIEW What Makes it Multiple? What Makes it Multiple? Additional Assumptions Additional Assumptions Methods of Entering Variables.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Lecture 11 PY 427 Statistics 1 Fall 2006 Kin Ching Kong, Ph.D
Multiple Linear Regression Introduction to Business Statistics, 5e Kvanli/Guynes/Pavur (c)2000 South-Western College Publishing.
Dependent (Criterion) Variable – Academic Success: Academic Major Grade Point Average (Major_GPA) Independent (Predictor) Variables: Socio Economic Status.
Lecture 6: Multiple Regression
Multiple Regression.
Data Analysis Statistics. Inferential statistics.
1 Chapter 17: Introduction to Regression. 2 Introduction to Linear Regression The Pearson correlation measures the degree to which a set of data points.
Week 14 Chapter 16 – Partial Correlation and Multiple Regression and Correlation.
Review Guess the correlation. A.-2.0 B.-0.9 C.-0.1 D.0.1 E.0.9.
Student Achievement and Predictors of Student Achievement in a State Level Agricultural Mechanics Career Development Event Edward Franklin Glen Miller.
CHAPTER 5 REGRESSION Discovering Statistics Using SPSS.
Multivariate Statistics Principal Components/Factor Analysis Structural Equation Modeling.
Bivariate Correlation Lesson 10. Measuring Relationships n Correlation l degree relationship b/n 2 variables l linear predictive relationship n Covariance.
Marketing Research Aaker, Kumar, Day and Leone Tenth Edition
Elements of Multiple Regression Analysis: Two Independent Variables Yong Sept
CHAPTER NINE Correlational Research Designs. Copyright © Houghton Mifflin Company. All rights reserved.Chapter 9 | 2 Study Questions What are correlational.
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
Bivariate Correlation Lesson 11. Measuring Relationships n Correlation l degree relationship b/n 2 variables l linear predictive relationship n Covariance.
Chapter 18 Some Other (Important) Statistical Procedures You Should Know About Part IV Significantly Different: Using Inferential Statistics.
The Goal of MLR  Types of research questions answered through MLR analysis:  How accurately can something be predicted with a set of IV’s? (ex. predicting.
Multiple regression - Inference for multiple regression - A case study IPS chapters 11.1 and 11.2 © 2006 W.H. Freeman and Company.
Chapter 17 Partial Correlation and Multiple Regression and Correlation.
Regression Analyses. Multiple IVs Single DV (continuous) Generalization of simple linear regression Y’ = b 0 + b 1 X 1 + b 2 X 2 + b 3 X 3...b k X k Where.
Prediction Confidence Intervals, Cross- validation, and Predictor Selection.
Part IV Significantly Different: Using Inferential Statistics
MBP1010H – Lecture 4: March 26, Multiple regression 2.Survival analysis Reading: Introduction to the Practice of Statistics: Chapters 2, 10 and 11.
Chapter 7 Relationships Among Variables What Correlational Research Investigates Understanding the Nature of Correlation Positive Correlation Negative.
Chapter 16 Data Analysis: Testing for Associations.
Multiple Correlation and Regression
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
 Relationship between education level, income, and length of time out of school  Our new regression equation: is the predicted value of the dependent.
UNDERSTANDING DESCRIPTION AND CORRELATION. CORRELATION COEFFICIENTS: DESCRIBING THE STRENGTH OF RELATIONSHIPS Pearson r Correlation Coefficient Strength.
Multiple Regression  Similar to simple regression, but with more than one independent variable R 2 has same interpretation R 2 has same interpretation.
B AD 6243: Applied Univariate Statistics Multiple Regression Professor Laku Chidambaram Price College of Business University of Oklahoma.
Using SPSS Note: The use of another statistical package such as Minitab is similar to using SPSS.
Multiple Regression David A. Kenny January 12, 2014.
Applied Quantitative Analysis and Practices LECTURE#28 By Dr. Osman Sadiq Paracha.
Bivariate Correlation Lesson 15. Measuring Relationships n Correlation l degree relationship b/n 2 variables l linear predictive relationship n Covariance.
LESSON 4.1. MULTIPLE LINEAR REGRESSION 1 Design and Data Analysis in Psychology II Salvador Chacón Moscoso Susana Sanduvete Chaves.
3.3. SIMPLE LINEAR REGRESSION: DUMMY VARIABLES 1 Design and Data Analysis in Psychology II Salvador Chacón Moscoso Susana Sanduvete Chaves.
Regression. Why Regression? Everything we’ve done in this class has been regression: When you have categorical IVs and continuous DVs, the ANOVA framework.
Topics: Multiple Regression Analysis (MRA)
Chapter 12 Understanding Research Results: Description and Correlation
Simple Bivariate Regression
Multiple Regression: II
Review Guess the correlation
Regression 11/6.
Regression 10/29.
Correlations NOT causal relationship between variables predictive.
Confidence Intervals, Cross-validation, and Predictor Selection
Regression.
Understanding Research Results: Description and Correlation
Introduction.
Chapter 7 Using Multivariate Statistics
CAAP Fall Report On Freshmen/Sophomores
Regression Analysis.
Dr. Green note. This starter slide deck generally follows the sequence of slides the department uses. Over time, some requirements tend to be added, this.
Bivariate Correlation
Presentation transcript:

Multiple Linear Regression Introduction

Multiple Regression One continuous Y, two or more X variables. X variables may be continuous or dichotomous k groups may be represented by k-1 dichotomous dummy variables

Obtain Weights for the X Variables Create a weighted combination of the Xs Such that the correlation between Y and is as large as possible. That is, a is predicted Y when all Xs are zero b i is number of points Y changes for each one point change in X i, above and beyond the effect of all other predictors.

Standardized (Beta) Weights  i is the number of standard deviations that Y i changes for each standard deviation change in X i, above and beyond the effect of all other predictors.

Sequential Analysis The predictors may be entered into the model all at once (simultaneous), or In sets of one or more (sequential) Order of entry may be determined by –Temporal relationships among predictors –A causal model –Economic considerations –Other considerations

Economic Considerations Want to predict college GPA. Enter inexpensive predictors first –High school GPA –Verbal and quantitative SAT –Evaluation of an essay submitted by student –Ratings from a panel of professors who interviewed the student on campus.

Stepwise Selection A statistical algorithm is used to determine order of entry. The goal is to create a model that has fewer predictors but does nearly as well as a model with all predictors. Stepwise selection is among the most misunderstood analyses known to man. It commonly leads to inappropriate conclusions.

Who Will Fail College Physics? McCammon, S., Golden, J., & Wuensch, K. L. (1988) Predict grades in physics classes from –Critical Thinking test scores (CT) –Thurstone’s Primary Mental Abilities Test (IQ) –Arithmetic skills test scores (ARI) –Algebra skills test scores (ALG) –Math anxiety scale scores (ANX)

Simultaneous Analysis R is the correlation between the weighted predictors and Y R =.40 and was statistically significant. Model explained 16% of the variance in grades. Every predictor was sig. correlated with grades (zero-order r). But in the model only ALG and CT had significant unique effects.

Stepwise Analysis Tried both Forwards Selection and Backwards Selection Both led to a model with only ALG and CT. We recommended that Physics use just the ALG and CT tests to predict who is at risk of failing. The motivation for using stepwise was economic – why use 5 predictors when 2 will do as well?

Does Sex Matter? McCammon insisted that I address this issue. Means and variances differed little between the sexes. Just to please McCammon, I did the analysis separately for men and women.

Sex Matters Among the men, not a single predictor was significantly related to grades. Among the women, every predictor was significantly related to grades. Women’s performance is class is well related to their abilities. There must be some other more important factor for predicting men’s performance.

Expert Reviewers Those at the physics journal to which we submitted the manuscript rejected it. They argued that it was not appropriate to publish an unexpected finding (the sex difference). Such “hypothesis-induced blindness” is not all that uncommon, unfortunately.

Political Correctness We submitted the manuscript to a Science Education journal. One reviewer insisted that it not be published as it is “sexist” to compare the sexes. We convinced the editor otherwise.