Multiple Regression: I

Slides:



Advertisements
Similar presentations
CORRELATION. Overview of Correlation u What is a Correlation? u Correlation Coefficients u Coefficient of Determination u Test for Significance u Correlation.
Advertisements

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
1 SSS II Lecture 1: Correlation and Regression Graduate School 2008/2009 Social Science Statistics II Gwilym Pryce
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Data Analysis Statistics. Inferential statistics.
CORRELATION. Overview of Correlation u What is a Correlation? u Correlation Coefficients u Coefficient of Determination u Test for Significance u Correlation.
Bivariate Regression CJ 526 Statistical Analysis in Criminal Justice.
Writing the Results Section
Linear Regression and Correlation
Elaboration Elaboration extends our knowledge about an association to see if it continues or changes under different situations, that is, when you introduce.
Data Analysis Statistics. Inferential statistics.
Dr. Mario MazzocchiResearch Methods & Data Analysis1 Correlation and regression analysis Week 8 Research Methods & Data Analysis.
Multiple Regression – Basic Relationships
Week 14 Chapter 16 – Partial Correlation and Multiple Regression and Correlation.
Relationships Among Variables
Chapter 12 Correlation and Regression Part III: Additional Hypothesis Tests Renee R. Ha, Ph.D. James C. Ha, Ph.D Integrative Statistics for the Social.
Introduction to Linear Regression and Correlation Analysis
Inference for regression - Simple linear regression
Elements of Multiple Regression Analysis: Two Independent Variables Yong Sept
Chapter 13: Inference in Regression
PowerPoint Template – delete this slide Fill in the appropriate slides Remove any bold or italicized words after you’ve added your changes Delete slides.
CHAPTER NINE Correlational Research Designs. Copyright © Houghton Mifflin Company. All rights reserved.Chapter 9 | 2 Study Questions What are correlational.
Regression Analysis. Scatter plots Regression analysis requires interval and ratio-level data. To see if your data fits the models of regression, it is.
Copyright © 2010 Pearson Education, Inc Chapter Seventeen Correlation and Regression.
Multiple regression - Inference for multiple regression - A case study IPS chapters 11.1 and 11.2 © 2006 W.H. Freeman and Company.
HOW TO WRITE RESEARCH PROPOSAL BY DR. NIK MAHERAN NIK MUHAMMAD.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Multiple Regression Lab Chapter Topics Multiple Linear Regression Effects Levels of Measurement Dummy Variables 2.
MGS3100_04.ppt/Sep 29, 2015/Page 1 Georgia State University - Confidential MGS 3100 Business Analysis Regression Sep 29 and 30, 2015.
Chapter 16 Data Analysis: Testing for Associations.
CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.
Political Science 30: Political Inquiry. Linear Regression II: Making Sense of Regression Results Interpreting SPSS regression output Coefficients for.
APA Results Section Results.
Multiple Correlation and Regression
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
 Relationship between education level, income, and length of time out of school  Our new regression equation: is the predicted value of the dependent.
Title Page The title page is the first page of your psychology paper. In order to make a good first impression, it is important to have a well-formatted.
Practical Statistics Regression. There are six statistics that will answer 90% of all questions! 1. Descriptive 2. Chi-square 3. Z-tests 4. Comparison.
Chapter 2 Understanding the Research Literature. Searching the literature Bibliographic databases Bibliographic databases –Proquest –ERIC –PsycINFO –
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
More on regression Petter Mostad More on indicator variables If an independent variable is an indicator variable, cases where it is 1 will.
Introduction to Statistics for the Social Sciences SBS200, COMM200, GEOG200, PA200, POL200, or SOC200 Lecture Section 001, Fall 2015 Room 150 Harvill.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Dr.Theingi Community Medicine
Linear Regression 1 Sociology 5811 Lecture 19 Copyright © 2005 by Evan Schofer Do not copy or distribute without permission.
Stats Methods at IC Lecture 3: Regression.
Module II Lecture 1: Multiple Regression
Predicting Energy Consumption in Buildings using Multiple Linear Regression Introduction Linear regression is used to model energy consumption in buildings.
Results Section Week 9.
32931 Technology Research Methods Autumn 2017 Quantitative Research Component Topic 4: Bivariate Analysis (Contingency Analysis and Regression Analysis)
Regression Analysis.
Simple Bivariate Regression
Correlation and Regression analysis
Multiple Regression: II
Regression Analysis Module 3.
26134 Business Statistics Week 5 Tutorial
Moderation, Mediation, and Other Issues in Regression
Regression Analysis.
INFERENTIAL STATISTICS: REGRESSION ANALYSIS AND STANDARDIZATION
Week 14 Chapter 16 – Partial Correlation and Multiple Regression and Correlation.
Multiple Regression – Part II
Stats Club Marnie Brennan
RESEARCH METHODS Trial
Prepared by Lee Revere and John Large
Keller: Stats for Mgmt & Econ, 7th Ed
Incremental Partitioning of Variance (aka Hierarchical Regression)
UNDERSTANDING RESEARCH RESULTS: STATISTICAL INFERENCE
1. Homework #2 (not on posted slides) 2. Inferential Statistics 3
Regression Analysis.
MGS 3100 Business Analysis Regression Feb 18, 2016
Presentation transcript:

Multiple Regression: I PSGE 7211

Goals Introduce multiple regression: What changes when I add more variables? Work on writing up results in APA style

Do Now What’s the difference between regression and correlation? How are they similar? How are they different? What would be an appropriate research question for a regression analysis?

Multiple Regression Multiple regression = regression with more than one IV DV: 8th grade overall GPA (100 pts) IVs: Parental schooling (yrs); Average homework time/week Entered into a simultaneous regression

Grades on Parent Ed, HW Parental Ed Grades Time HW

Grades on Parent Ed, HW

Grades on ParEd, HW r2pared = (.191)2 = .036 r2hw = (.354)2 = .125

Grades on ParEd, HW Multiple Correlation Coefficient (“Mult R”) R2 = .36 x .36 = .130 13% of variance of GPA is explained by PARED, HWRK Adusted R2 = accounts for # of predictors in model .036 .125 Question: Why isn’t the R2 = r2hwork + r2pared

Parental Ed Grades Time HW Grades TimeHW ParEd

Grades TimeHW ParEd Grades TimeHW ParEd Multicollinearity!

Overall model is significant, which indicates that taken together, years of schooling and average time spent on homework explains a significant proportion of the variance in 8th grade GPA

No time spent on homework, Parents never attended school y’ = a + bx1 + bx2 + e Predicted value of GPA = 69.984 + .258(PARED) + 1.143(HWORK) No time spent on homework, Parents never attended school = 69.984 + .258(16 yrs) + 1.143(5 hrs) = 79.827

Note that HWORK is significant but PARED is not. What does this mean? For each additional hour spent on homework, GPA is expected to go up 1.143 points However, PARED is not statistically significant, indicating that it does not adequately predict GPA. Thus, the only conclusion that can be drawn is that HWORK is a better predictor of grades than PARED.

Assuming that PARED was significant and entered as a control variable, then... For each additional hour students with parents who attended an average number of years in school (i.e., 14 years) spend on homework, their GPA will go up [1.143 + (14*.253)] or 4.685 points

Confidence Intervals: give us a range of possible values for the coefficients. Although we may not be entirely certain that the true value falls in the calculated range, we can be reasonably confident Hypothesis tests are used to answer the question of whether or not the true coefficient is zero; if the coefficient is not significant, 0 will be in the range (see PARED) We can be 95% confident that the true coefficient for HWORK lies between .440 and 1.847

b and Betas b = unstandardized coefficients B = standardized coefficients (b transformed into standard deviation units)

Interpreting findings Interpretations Formal (e.g., results section) In English (e.g., discussion section) “Real World” (e.g., explain to a parent, teacher, student, policy maker)

Formal Formal: This research was designed to determine the influence of time spent on homework on 8th grade students’ GPAs, while controlling for parents’ level of education. Students’ 8th-grade GPAs were regressed on average time spent on homework per week and parents’ level of education. The overall multiple regression was significant (F(2, 97) = 7.242, p < .01), and the two variables accounted for 13% of the variance in GPA. Only homework was found to have a statistically significant effect on grades, t(97) = 3.224, p<.01. Controlling for parental education, for every additional hour spent on homework, students’ GPAs are expected to increase 1.143 points.

English English: The results suggest that while parental education may not be an important predictor of student GPA, the amount of time spent on homework has a marked influence on 8th grade achievement. Spending, on average, one hour per week on homework should result in almost a one-point increase in students’ overall GPA.

Real World? Real World: What would be your real world explanation of these findings?

Lab Time One more example Conduct a multiple regression analysis on your dataset Writing up regression analyses Check the wiki – “writing up regression results” Revise HW 3 and/or 4

Writing up regression analyses Results Overview of purpose of the study Preliminary analyses Descriptives (can summarize in a table) Correlational analyses (can summarize in a table or report in text) Main analyses Regression analyses

HW 5 On a dataset of your choice: Run Multiple regression analysis (2 predictors, I continuous DV) Write up your findings in short APA style format Provide a brief introduction (overall purpose of your analyses) Present preliminary analyses (descriptives and correlations) Present analyses on multiple regression Use APA-style tables to present your descriptive statistics and correlational analyses