MGTO 324 Workshop 5: Construct Validity. Factor Analysis Suppose you have chosen 4 items (Q1 to Q4 from the data file provided: Q1: Gaze at me; Q2: Touch.

Slides:



Advertisements
Similar presentations
Conceptualization and Measurement
Advertisements

Performance Management Guide for Supervisors. Objectives  Understand necessity of reviews;  To define a rating standard across the Foundation for an.
Clinical Assessment (I) : The Assessment Interview
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
You’ve Been Shown: Now It’s Your Turn to Ask! CLEAR 2004Kansas City, Missouri Responding to Your Questions About Testing.
Work Ethics- What kind of employee are you?
Do you know where you are going to? Theme from Mahogany Diana Ross Do you know where you are going to? Do you like the things that life is showing you?
Copyright (c) Bani K. Mallick1 STAT 651 Lecture #18.
ICE Evaluations Some Suggestions for Improvement.
Performance Appraisals
MGTO 324 Workshop 6: Criterion Validity. Multiple Regression Analysis Background You are an HR manager of an insurance firm. The most salient culture.
Index and Scale Similarities: Both are ordinal measures of variables. Both rank order units of analysis in terms of specific variables. Both are measurements.
In the name of Allah. Development and psychometric Testing of a new Instrument to Measure Affecting Factors on Women’s Behaviors to Breast Cancer Prevention:
Lesson Thirteen Standardized Test. Yuan 2 Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized.
Project proposal and approval. This is a formal process that helps you and your supervisor ensure you have chosen an appropriate area of study that will.
Welcome Cynthia Johnson, Personnel Management and Classification Manager OFFICE OF STATE EXAMINER MELINDA B. LIVINGSTON, STATE EXAMINER.
MGTO 324 Workshop 4: Reliability. Activity 1 Use the data management concepts discussed in the last lesson to input all the data provided on the given.
National Outcomes and Casemix Collection Training Workshop
CHAPTER 4 Research in Psychology: Methods & Design
Measurement in Exercise and Sport Psychology Research EPHE 348.
Copyright © 2003 by The McGraw-Hill Companies, Inc. All rights reserved.
Research Method Step 1 – Formulate research question Step 2 – Operationalize concepts ◦ Valid and reliable indicators Step 3 – Decide on sampling technique.
Indicators of Family Engagement Melanie Lemoine and Monica Ballay Louisiana State Improvement Grant/SPDG.
MGTO 324 Recruitment and Selections Validity II (Criterion Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
Statistics for the Social Sciences Psychology 340 Spring 2006 Factorial ANOVA.
Study of the day Misattribution of arousal (Dutton & Aron, 1974)
Factor validation of the Consideration of Future Consequences Scale: An Assessment and Review Tom R. EikebrokkEllen K. NyhusUniversity of Agder.
A Professional Development Workshop for Teachers.
MGTO 324 Recruitment and Selections Validity I (Construct Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
MGTO 324 Recruitment and Selections Introduction Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University of Science &
Factor Analysis Revealing the correlational structure among variables Understanding & Reducing Complexity.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.
Dr. Kelly Bruning 1. 2 If you have any trouble in seminar, please call Tech Support at: They can assist if you get “bumped” from the seminar.
PreK CIRCLE Progress Monitoring Training September 2015 Midland ISD.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Using Measurement Scales to Build Marketing Effectiveness CHAPTER ten.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Performance Appraisals
Local AIMSweb® Manager: Taking the Role An introduction to: Course Overview Role of a Local AIMSweb Manager (LAM) Skills needed to become a successful.
Introduction to Item Analysis Objectives: To begin to understand how to identify items that should be improved or eliminated.
Measurements Jaremilleta M. Arawiran January 22, 2010 Library Multifunction Room.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
CHAPTER 6 Selecting Employees and Placing Them in Jobs
SECOND EDITION Chapter 5 Standardized Measurement and Assessment
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
Challenge Question: What is the value of keeping logs and journals as an educator? Self-Test Questions: 1.How do you determine appropriate uses of logs.
Dr. Michael R. Hyman, NMSU Attitude Measurement (Click icon for audio)
Chapter 6 Indexes, Scales, And Typologies. Chapter Outline Indexes versus Scales Index Construction Scale Construction.
Performance Indicator 4.08 Creating a Survey Describe the use of technology in the marketing-information management function.
Quality instrument* Questions are determined by objectives Resist the temptation to ask questions that are interesting but not relevant to your hypothesis.
Sharing Your School Climate Data with STAFF Directions for PowerPoint users: The following is a sample template for sharing your DSCS results.
Consider This! The Development of a Considerateness Scale
Indexes, Scales, and Typologies
CHAPTER 4 Research in Psychology: Methods & Design
Motivation to Redesign
assessing scale reliability
BUS 310 STUDY Future Starts Here/bus310study.com
Measuring Athlete Coachability
Using Measurement Scales to Build Marketing Effectiveness
HRM 326 Possible Is Everything/tutorialrank.com
PSYCH 655 Enthusiastic Studysnaptutorial.com
HRM 326 Education for Service/tutorialrank.com
Chapter 6 Indexes, Scales, And Typologies
Mini Quiz 1. Data that derive from the researcher's direct observation of what the subject does in some predefined context are a. L data. b. I data.
Indexes, Scales, and Typologies
Standard Deviation Standard Deviation summarizes the amount each value deviates from the mean. SD tells us how spread out the data items are in our data.
Literature Circle Expectations
Measurement Concepts and scale evaluation
2010 Audit Summary Results YEAR 100% Verified Failed Reduced 2010
Assessment Chapter 3.
Presentation transcript:

MGTO 324 Workshop 5: Construct Validity

Factor Analysis Suppose you have chosen 4 items (Q1 to Q4 from the data file provided: Q1: Gaze at me; Q2: Touch me; Q3: Listen to my complaints; Q4: Make me laugh whenever I feel sad) to measure love and recruited 60 people to answer them.

Factor Analysis Try to use factor analysis to (a) specify how many factor(s) there are and why? (b) give appropriate label(s) to the factors.

Interpretation Determining number of factors Eigenvalues The first two factors accounted for 49% and 39% of variance, respectively The third factor, added only 8% A two-factor model is favored

Interpretation Determining number of factors Plotting Eigenvalues A graphic determination

How should the items be classified?

Assignment Background Suppose you are an HR consultant. You asked your subordinates to construct a scale measuring “Rationality”. On the basis of some economics and psychology literature, you realized that “rationality” has two very different components, namely “logical thinking” and “emotional control”. You passed this information to your subordinates and let them construct the test. One month later, one of your assistants presented a 10-item scale to you. The first five items were supposed to measure “logical thinking” and the other five were supposed to measure “emotional control”. You then distributed this scale to 60 employees as well as their immediate supervisors. Each employee responded to all ten items and received 10 more responses of the same scale from his/her supervisor.

Assignment Task Assess the reliability of all scales and subscales Use factor analysis to examine the construct validity of the test Use Multi-trait-multi-method to examine the construct validity of the test (Hint: you have to compute a mean score for each scale)