2. Chapter 11 REGRESSION

3. Multiple Regression  Uses  Explanation  Prediction

4. Multiple Regression  Based On: Correlations Characteristics of a straight line

5. Regression vs. Multiple Regression  One independent variable vs. more than one independent variable  One dependent variable

6. Multiple Regression TType of Data Required Independent variables CCategorical - can be coded for entry CContinuous - meet assumptions Dependent variable CContinuous - should be normally distributed

7. AAssumptions Sample representative of population Variables should have normal distribution Homoscedasticity Linear relationship between variables

8.  Power analysis If sample size = number of variables, Rsquared will equal 1.00. Generally need 20 - 30 subjects per independent variable Less than 10 subjects per independent variable leads to serious error

9. Relationship of correlation to regression  Perfect correlation?  No correlation?  Imperfect correlation?

10. Regression Equation  Formula for a straight line  Predicted score = constant plus regression weight times score  Y’ = a + bX  Y’ = a + b1X1 + b2X2 = B3X3

11. Regression Equation  Predicted score Y’  Constant a value of Y when X = 0 point where regression line intercepts the Y axis  regression coefficient/s b or beta rate of change in Y with a unit change in X measure of slope of regression line

12. Regression Equation  Constant or a is based on means of variables involved  Regression coeffients, b or beta, based on correlation between two variables

13. Regression coefficients  The b-weights are based on raw scores  Beta-weights are based on standardized scores and are partial correlation coefficients

14. Regression line  Least squares  “Line of best fit”  Deviations around this line sum to zero Deviations are the differences between the actual and predicted scores

15. Computer Example  What is the multiple correlation between a group of independent variables entered in three blocks and the dependent variable, total positive psychological attitudes?  Block 1: Age and education  Block 2: Smoking hx and exercise  Block 3: Sat. with wt. and Health

16. SPSS - Multiple Regression  ANALYZE Regression  Linear Statistics  Confidence intervals  R squared change  Descriptives  Part and partial correlations Options  Exclude cases pairwise

17. Dummy coding  Uses 1s and 0s  a = mean of dependent variable for group assigned 0s throughout  b - tests the difference between the group assigned 1 on the variable and the group assigned 0s throughout

18. Dummy coding  Vector 1 Republicans = 1 Democrats = 0 Independents = 0  Vector 2 Republicans = 0 Democrats = 1 Independents = 0

19. SPSS - creating dummy variables  TRANSFORM Compute  New variable with new value  IF create conditional expression

20. Effect Coding  Uses 1s, 0s, and -1s  a = grand mean of dependent variable  b tests the difference between the mean of the group assigned 1 and the grand mean  the b-weights add up to zero

21. Effect Coding  Vector 1 Republicans 1 Democrats 0 Independents -1  Vector 2 Republicans 0 Democrats 1 Independents -1

22. MULTIPLE REGRESSION  Selecting Variables for the Equation Standard (ENTER) Hierarchical (Setwise) Stepwise  Forward  Backward  Stepwise

23. Mediator and Moderator Variables

24. Mediator Variable  A variable seen as “between” the independent and dependent variable.  Tested with multiple regression/path analysis

25. Moderator Variable  Affects the association between an independent and dependent variable.  Test for an interaction between the moderator and another independent variable using hierarchical multiple regression.

26. Example from the literature