MGTO 324 Workshop 6: Criterion Validity. Multiple Regression Analysis Background You are an HR manager of an insurance firm. The most salient culture.

Slides:



Advertisements
Similar presentations
Things to do in Lecture 1 Outline basic concepts of causality
Advertisements

Forecasting Using the Simple Linear Regression Model and Correlation
Simple Regression Model
Multiple Regression. Outline Purpose and logic : page 3 Purpose and logic : page 3 Parameters estimation : page 9 Parameters estimation : page 9 R-square.
Chapter 6 (p153) Predicting Future Performance Criterion-Related Validation – Kind of relation between X and Y (regression) – Degree of relation (validity.
© McGraw-Hill Higher Education. All Rights Reserved. Chapter 2F Statistical Tools in Evaluation.
Regression With Categorical Variables. Overview Regression with Categorical Predictors Logistic Regression.
Correlational Research 1. Spare the rod and spoil the child 2. Idle hands are the devil’s workplace 3. The early bird catches the worm 4. You can’t teach.
Some Terms Y =  o +  1 X Regression of Y on X Regress Y on X X called independent variable or predictor variable or covariate or factor Which factors.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
MULTIPLE REGRESSION. OVERVIEW What Makes it Multiple? What Makes it Multiple? Additional Assumptions Additional Assumptions Methods of Entering Variables.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
Statistics for the Social Sciences
MGTO 324 Workshop 5: Construct Validity. Factor Analysis Suppose you have chosen 4 items (Q1 to Q4 from the data file provided: Q1: Gaze at me; Q2: Touch.
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Review of the fundamental concepts of probability Exploratory data analysis: quantitative and graphical data description Estimation techniques, hypothesis.
Ch. 14: The Multiple Regression Model building
Correlational Designs
Correlation 1. Correlation - degree to which variables are associated or covary. (Changes in the value of one tends to be associated with changes in the.
Multiple Regression Research Methods and Statistics.
Chapter 7 Evaluating What a Test Really Measures
CORRELATIO NAL RESEARCH METHOD. The researcher wanted to determine if there is a significant relationship between the nursing personnel characteristics.
Simple Linear Regression Analysis
SPSS Statistical Package for Social Sciences Multiple Regression Department of Psychology California State University Northridge
Correlational Research Strategy. Recall 5 basic Research Strategies Experimental Nonexperimental Quasi-experimental Correlational Descriptive.
Inferential statistics Hypothesis testing. Questions statistics can help us answer Is the mean score (or variance) for a given population different from.
Introduction to Regression Analysis. Two Purposes Explanation –Explain (or account for) the variance in a variable (e.g., explain why children’s test.
MGTO 324 Recruitment and Selections Validity II (Criterion Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
1 1 Slide Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple Coefficient of Determination n Model Assumptions n Testing.
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
Statistics for the Social Sciences Psychology 340 Fall 2013 Correlation and Regression.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
Multiple Linear Regression Partial Regression Coefficients.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
CORRELATION: Correlation analysis Correlation analysis is used to measure the strength of association (linear relationship) between two quantitative variables.
Chapter 13 Multiple Regression
Scatterplots & Regression Week 3 Lecture MG461 Dr. Meredith Rolfe.
 Relationship between education level, income, and length of time out of school  Our new regression equation: is the predicted value of the dependent.
Correlation & Regression Analysis
Chap 6 Further Inference in the Multiple Regression Model
Residual Plots Unit #8 - Statistics.
Psychology 202a Advanced Psychological Statistics November 10, 2015.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
Moderated Multiple Regression II Class 25. Regression Models Basic Linear Model Features: Intercept, one predictor Y = b 0 + b 1 + Error (residual) Do.
©2005, Pearson Education/Prentice Hall CHAPTER 6 Nonexperimental Strategies.
Applied Quantitative Analysis and Practices LECTURE#28 By Dr. Osman Sadiq Paracha.
Week of March 23 Partial correlations Semipartial correlations
Scatter Plots & Lines of Best Fit To graph and interpret pts on a scatter plot To draw & write equations of best fit lines.
Michael J. Kalsher PSYCHOMETRICS MGMT 6971 Regression 1 PSYC 4310 Advanced Experimental Methods and Statistics © 2014, Michael Kalsher.
Introduction Many problems in Engineering, Management, Health Sciences and other Sciences involve exploring the relationships between two or more variables.
Regression. Why Regression? Everything we’ve done in this class has been regression: When you have categorical IVs and continuous DVs, the ANOVA framework.
Basic Estimation Techniques
Regression The basic problem Regression and Correlation
Review. Review Statistics Needed Need to find the best place to draw the regression line on a scatter plot Need to quantify the cluster.
Chapter 6 Predicting Future Performance
Multivariate Analysis Lec 4
Week 10 Slides.
1) A residual: a) is the amount of variation explained by the LSRL of y on x b) is how much an observed y-value differs from a predicted y-value c) predicts.
Basic Estimation Techniques
Lesson 5.3 How do you write linear equations in point-slope form?
Merve denizci nazlıgül, M.s.
Interpretation of Regression Coefficients
HW# : Complete the last slide
Regression and Categorical Predictors
Chapter 6 Predicting Future Performance
3.2. SIMPLE LINEAR REGRESSION
Cases. Simple Regression Linear Multiple Regression.
Presentation transcript:

MGTO 324 Workshop 6: Criterion Validity

Multiple Regression Analysis Background You are an HR manager of an insurance firm. The most salient culture in this organization is that they want their insurance agents to be creative in helping their clients solve their financial problems. calm and patient in listening and understanding the clients’ needs. Supervisors gave an overall performance rating for each agent according to the above criteria. Suppose you used two personality scales, Openness to Experience and Emotional Stability, to predict job performance. You choose to measure these two personality traits because they are theoretically related to job performance in this context. You collected the personality data two years ago and the job performance ratings this year.

Criterion-related validity Try to show criterion-related evidence of the two personality scales In addition, try to show the value of the personality tests by assessing the incremental validity of each scale

Simple correlation

Scatter Plot

r =.526; p <.05

r =.53; p <.05

Linear Regression

PR = x OE; Z(PR) =.526 x Z(OE) This equation accounts for 27.6% of the PR’s variance, and it is significantly better than 0%.

r =.526; p <.05 Z(PR) =.526 x Z(OE)

Multiple regression Equal to linear regression, except that more than one predictor in the equation PR = Constant + B(OP) x OP + B(ES) x ES

Interpretation OE and ES are both significant predictors. The explained unique portion of the PR’s variance. That is, their predictions could not be replaced by other predictors in the equation, which shows the incremental validity.

Multiple Regression Analysis Background You are an HR manager of a firm. There are two performance criteria Salary increase after the first year’s performance appraisal Quit intention After reviewing some leading research articles in Journal of Applied Psychology, Personnel Psychology, and Academy of Management Journal, you are thinking that perhaps their job satisfaction and job commitment to their previous jobs (i.e., before joining your organization) may predict these two variables You also have an intuition that the outcome criteria should be related to one’s Extraversion You measured their job satisfaction, job commitment, and Extroversion before joining your firm You got the two criteria data one year after performance appraisal

Assignment Task Show the criterion validity of each predictor Show the incremental validity of each predictor Comments on the usefulness of each predictor Comments on any interesting observation