Survey of Major Correlational Models/Questions simple correlation questions obtaining and comparing bivariate correlations statistical control questions.

Slides:



Advertisements
Similar presentations
MANOVA (and DISCRIMINANT ANALYSIS) Alan Garnham, Spring 2005
Advertisements

Overview of Techniques Case 1 Independent Variable is Groups, or Conditions Dependent Variable is continuous ( ) One sample: Z-test or t-test Two samples:
Canonical Correlation simple correlation -- y 1 = x 1 multiple correlation -- y 1 = x 1 x 2 x 3 canonical correlation -- y 1 y 2 y 3 = x 1 x 2 x 3 The.
Survey of Major Correlational Models/Questions Still the first & most important is picking the correct model… Simple correlation questions simple correlation.
Partial and Semipartial Correlation
Automated Regression Modeling Descriptive vs. Predictive Regression Models Four common automated modeling procedures Forward Modeling Backward Modeling.
Research Hypotheses and Multiple Regression: 2 Comparing model performance across populations Comparing model performance across criteria.
 It was introduced by Karl Pearson in  In Statistics, Regression analysis is a method for the prediction of future events.  The relationship.
Inference for Regression
Regression single and multiple. Overview Defined: A model for predicting one variable from other variable(s). Variables:IV(s) is continuous, DV is continuous.
MULTIPLE REGRESSION. OVERVIEW What Makes it Multiple? What Makes it Multiple? Additional Assumptions Additional Assumptions Methods of Entering Variables.
More on ANOVA. Overview ANOVA as Regression Comparison Methods.
CORRELATION. Overview of Correlation u What is a Correlation? u Correlation Coefficients u Coefficient of Determination u Test for Significance u Correlation.
Research Hypotheses and Multiple Regression Kinds of multiple regression questions Ways of forming reduced models Comparing “nested” models Comparing “non-nested”
Regression Models w/ k-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Multiple Regression Models Advantages of multiple regression Important preliminary analyses Parts of a multiple regression model & interpretation Differences.
Multiple Regression Models: Some Details & Surprises Review of raw & standardized models Differences between r, b & β Bivariate & Multivariate patterns.
Survey of Major Correlational Models/Questions Still the first & most important is picking the correct model… Simple correlation questions simple correlation.
Simple Regression correlation vs. prediction research prediction and relationship strength interpreting regression formulas –quantitative vs. binary predictor.
Ch 11: Correlations (pt. 2) and Ch 12: Regression (pt.1) Apr. 15, 2008.
Power Analysis for Correlational Studies Remember that both “power” and “stability” are important! Useful types of power analyses –simple correlations.
Simple Correlation Scatterplots & r Interpreting r Outcomes vs. RH:
Multivariate Analyses & Programmatic Research Re-introduction to Multivariate research Re-introduction to Programmatic research Factorial designs  “It.
Some Details about Bivariate Stats Tests Conceptualizing the four stats tests Conceptualizing NHST, critical values and p-values NHST and Testing RH: Distinguishing.
Bivariate & Multivariate Regression correlation vs. prediction research prediction and relationship strength interpreting regression formulas process of.
Ch 11: Correlations (pt. 2) and Ch 12: Regression (pt.1) Nov. 13, 2014.
Simple Correlation RH: correlation questions/hypotheses and related statistical analyses –simple correlation –differences between correlations in a group.
Correlational Designs
An Introduction to Classification Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification.
Multiple Regression Research Methods and Statistics.
Experimental Group Designs
Statistics for the Social Sciences Psychology 340 Fall 2013 Tuesday, November 19 Chi-Squared Test of Independence.
Elements of Multiple Regression Analysis: Two Independent Variables Yong Sept
Chapter 14 – Correlation and Simple Regression Math 22 Introductory Statistics.
Power Analysis Determining Sample Size for “the study”
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
Chapter 18 Some Other (Important) Statistical Procedures You Should Know About Part IV Significantly Different: Using Inferential Statistics.
Statistical Control Statistical Control is about –underlying causation –under-specification –measurement validity –“Correcting” the bivariate relationship.
Coding Multiple Category Variables for Inclusion in Multiple Regression More kinds of predictors for our multiple regression models Some review of interpreting.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
ANOVA and Linear Regression ScWk 242 – Week 13 Slides.
Multiple Linear Regression Partial Regression Coefficients.
Discriminant Analysis Discriminant analysis is a technique for analyzing data when the criterion or dependent variable is categorical and the predictor.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Practical Statistics Regression. There are six statistics that will answer 90% of all questions! 1. Descriptive 2. Chi-square 3. Z-tests 4. Comparison.
© Buddy Freeman, 2015 Multiple Linear Regression (MLR) Testing the additional contribution made by adding an independent variable.
Regression Models w/ 2 Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting the regression.
Chapter 16 Data Analysis: Testing for Associations.
Chapter 13 - ANOVA. ANOVA Be able to explain in general terms and using an example what a one-way ANOVA is (370). Know the purpose of the one-way ANOVA.
Regression Models w/ 2-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
Correlation. Up Until Now T Tests, Anova: Categories Predicting a Continuous Dependent Variable Correlation: Very different way of thinking about variables.
Simple Correlation Scatterplots & r –scatterplots for continuous - binary relationships –H0: & RH: –Non-linearity Interpreting r Outcomes vs. RH: –Supporting.
Multiple Regression. From last time There were questions about the bowed shape of the confidence limits around the regression line, both for limits around.
Developing a Hiring System Measuring Applicant Qualifications or Statistics Can Be Your Friend!
4 basic analytical tasks in statistics: 1)Comparing scores across groups  look for differences in means 2)Cross-tabulating categoric variables  look.
Multiple Regression. PSYC 6130, PROF. J. ELDER 2 Multiple Regression Multiple regression extends linear regression to allow for 2 or more independent.
Multiple Regression Learning Objectives n Explain the Linear Multiple Regression Model n Interpret Linear Multiple Regression Computer Output n Test.
SOCW 671 #11 Correlation and Regression. Uses of Correlation To study the strength of a relationship To study the direction of a relationship Scattergrams.
Applied Quantitative Analysis and Practices LECTURE#28 By Dr. Osman Sadiq Paracha.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, partial correlations & multiple regression Using model plotting to think about ANCOVA & Statistical control Homogeneity.
Chapter 8 Relationships Among Variables. Outline What correlational research investigates Understanding the nature of correlation What the coefficient.
Week of March 23 Partial correlations Semipartial correlations
Linear Discriminant Function Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification & LDF.
کارگاه حجم نمونه با نرم افزار G*Power
Trivariate Regression
Prediction/Regression
Prediction/Regression
Chapter 8: Relationships among Variables
Presentation transcript:

Survey of Major Correlational Models/Questions simple correlation questions obtaining and comparing bivariate correlations statistical control questions what “would be” the bivariate correlation is all participants had the same score on some “control variable”? multiple correlation questions obtaining and comparing models with multiple predictors

Simple Correlation questions (old friends) r y,x1 simple correlation of y and x1 r y,x1 vs. r y,x2 comparing “correlated” correlations within a population/group (uses Hotelling’s t-test or M,R&R Z-test) r y,x1 vs. r y,x1 comparing the same bivariate correlation in 2 populations/grps (uses Fisher’s Z-test) Examples… Is there a relationship between # therapy sessions and symptomatic improvement? Is # therapy sessions a better predictor of symptomatic improvement than initial level of depression? Is # therapy sessions a better predictor of symptomatic improvement for adults than for adolescents? r imp,#ses r imp,#ses vs. r imp,init r imp,#ses for adults vs r imp,#ses for adolescents.

Does amount of practice predict performance better for novices that for experiences individuals? Does amount of practice predict level of performance? Does amount of practice predict performance better then prior experience? Same r, dif populations r perf,pract for novices vs. r perf,pract for experienced Use Fisher’s Z-test Simple r -- r perf,pract Compare r’s in the same pop r perf,pract vs. r perf,exp Hotelling’s t-test & Steiger’s Z-test Which type is each of the following? Use the notation & tell test used for each type of comparison

Statistical Control questions partial correlation questions -- is the relationship BOTH variables have with some 3rd variable(s) “producing” the bivariate relationship between them? r y,x1.x2 partial correlation of y & x1 controlling both for x2 (control var listed to right of “.” ) r y,x1.x2,x3 multiple partial correlation of y & x1 controlling both for x2 and x3 semi-partial (part) questions -- is the relationship JUST ONE of the variables have with some 3rd variable(s) “producing” the bivariate relationship between them? r y,(x1.x2) semi-partial correlation of y & x1, controlling the latter for x2 “( )” around variable being controlled and control variable r y,(x1.x2,x3) multiple semi-partial correlation of y & x1, controlling latterfor x2 & x3 “( )” around variable being controlled and control variables

Examples … Are # sessions and symptomatic improvement correlated after controlling symptomatic improvement for initial depression. Are # sessions and symptomatic improvement correlated after controlling both for initial depression? Are # sessions and symptomatic improvement correlated after controlling both for initial depression and age? Are # sessions and symptomatic improvement correlated after controlling symptomatic improvement for initial depression and age. Partial correlation r #ses,imp.init Multiple partial r #ses,imp.init,age Semi-partial r #ses (imp.init) Multiple semi-partial r #ses,imp (init,age)

Does practice predict performance after controlling both for prior experience? Does practice predict performance after controlling performance for prior experience and age? Does practice predict performance after controlling performance for age? Does practice predict performance after controlling both for prior experience and age? partial r perf,prac.exp multiple semi-partial r prac(perf.exp,age) semi-partial r prac(perf.age) multiple partial r perf,prac.exp,age Which type is each of the following?

Multiple Regression questions R y.x1,x2,x3,x4 ² multiple correlation with y as the criterion and x1, x2, x3 and x4 as predictors predictors to right of “.” R y.x1,x2,x3,x4 ² vs. R y.x1,x2, ² comparing nested models (uses R 2 change F-test) R y.x1,x2 ² vs. R y.,x3,x4 ² comparing non-nested models (uses Hotelling’s t-test or M,F&R Z-test) R y.x1,x2,x3,x4 ² vs. R y.x1,x2,x3,x4 ² comparing the same multiple regression model in two different populations (uses Fisher’s Z-test & H’s t or M,R&R Z-test) R y.x1,x2,x3,x4 ² vs. R z.x1,x2,x3,x4 ² comparing the same multiple regression model with two different criterion, in the same population ( Hotelling’s t-test & Steiger’s Z-test )

Examples… Symptomatic improvement is predicted from a combination of # sessions, initial depression and age. Symptomatic improvement is predicted from a combination of # sessions, initial depression and age and prediction is improved by adding # of prior therapists. Symptomatic improvement is predicted better from a combination of # sessions, initial depression and age than from # sessions & # of prior therapists. Symptomatic improvement is predicted from a combination of # sessions, initial depression and age better for adults than for adolescents. A combination of # sessions, initial depression and age predicts symptomatic improvement better than it predicts treatment satisfaction. R imp.#ses,init,age 2 vs. R imp.#ses,init,age,#ther 2 R imp.#ses,init,age 2 R imp.#ses,init,age 2 vs. R imp.#ses,#ther 2 R imp.#ses,init,age 2 for adults vs. for adolescents R imp.#ses,init,age 2 vs. R tsat.#ses,init,age 2

Do practice, prior skill and motivation predict performance? Do practice, prior skill and motivation predict performance on a speeded task as well as they they predict performance on an accuracy task? Do practice, prior skill and motivation predict performance as well as do prior skill and motivation? Do practice, prior skill and motivation predict performance as well as do practice, motivation and age? Do practice, prior skill and motivation predict performance as well for amateurs as for professionals? single model R perf.prac,skill 2 single model for 2 criterion H & MMR R speed.prac,skill 2 vs. R acc.prac,skill 2 nested model comparisons R 2 -  F-test R perf.prac,skill,mot 2 vs. R perf.prior,mot 2 non-nested models H & MMR R perf.prac,skill,mot 2 vs. R perf.prac,mot,age 2 R 2 for 2 populations F’s Z-test - H&MM R perf.prac,skill,mot 2 Which type is each of the following? Use the notation & tell the test used for each model comparison

Two important things to remember: 1.Simple (bivariate) correlation and simple (bivariate) regression ask exactly the same question – is there a bivariate relationship between these variables? Even the H0:s and significant tests are equivalent… Correlation H0: r=0 Regression H0: b=0 2. Whether a variable contributes to a particular model can be tested two ways … a.The test of that variables regression (b) weight in the multiple regression model H0: b 3 =0 in y’ = b 1 x 1 + b 2 x 2 + b 3 x 3 + a b.The multiple semi-partial between the criterion and that predictor, after controlling that predictor for all of the other predictors H0: r y(x3.x1, x2) = 0