MGTO 231 Human Resources Management Personnel selection I Dr. Kin Fai Ellick WONG.

Slides:



Advertisements
Similar presentations
Agenda Levels of measurement Measurement reliability Measurement validity Some examples Need for Cognition Horn-honking.
Advertisements

Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
How good are our measurements? The last three lectures were concerned with some basics of psychological measurement: What does it mean to quantify a psychological.
Reliability and Validity
Increasing your confidence that you really found what you think you found. Reliability and Validity.
Chapter 4 – Reliability Observed Scores and True Scores Error
1Reliability Introduction to Communication Research School of Communication Studies James Madison University Dr. Michael Smilowitz.
What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
Survey Methodology Interviewing EPID 626 Lecture 9.
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Research Methods in Psychology
Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Unit 11 Test: part II FRQ Grading Rubrics
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Concept of Measurement
Psych 231: Research Methods in Psychology
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Overview of Lecture Independent and Dependent Variables Between and Within Designs.
Variables cont. Psych 231: Research Methods in Psychology.
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 6 Chicago School of Professional Psychology.
Validity, Reliability, & Sampling
Research Methods in MIS
Chapter 5 Selection Objectives and goals Selection Procedures
Chapter 8 Introduction to Hypothesis Testing
MATH1342 S08 – 7:00A-8:15A T/R BB218 SPRING 2014 Daryl Rupp.
Experimental Research
Measurement in Exercise and Sport Psychology Research EPHE 348.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Technical Adequacy Session One Part Three.
Foundations of Recruitment and Selection I: Reliability and Validity
Final Study Guide Research Design. Experimental Research.
MGTO 324 Recruitment and Selections Validity II (Criterion Validity) Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong University.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
MGTO 324 Recruitment and Selections Personnel Judgment and Decision Making Kin Fai Ellick Wong Ph.D. Department of Management of Organizations Hong Kong.
MGTO 231 Human Resources Management Personnel selection II Dr. Kin Fai Ellick WONG.
Creating Assessments AKA how to write a test. Creating Assessments All good assessments have three key features: All good assessments have three key features:
Independent vs Dependent Variables PRESUMED CAUSE REFERRED TO AS INDEPENDENT VARIABLE (SMOKING). PRESUMED EFFECT IS DEPENDENT VARIABLE (LUNG CANCER). SEEK.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
HYPOTHESIS TESTING Null Hypothesis and Research Hypothesis ?
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
HYPOTHESIS TESTING Null Hypothesis and Research Hypothesis ?
Topic #5: Selection Theory
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
Chapter 8: Introduction to Hypothesis Testing. Hypothesis Testing A hypothesis test is a statistical method that uses sample data to evaluate a hypothesis.
5. Evaluation of measuring tools: reliability Psychometrics. 2011/12. Group A (English)
Reliability. Basics of test score theory Each person has a true score that would be obtained if there were no errors in measurement. However, measuring.
VALIDITY What is validity? What are the types of validity? How do you assess validity? How do you improve validity?
© 2013 by Nelson Education1 Foundations of Recruitment and Selection I: Reliability and Validity.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Designing psychological investigations
Reliability and Validity in Research
RELIABILITY OF QUANTITATIVE & QUALITATIVE RESEARCH TOOLS
Journalism 614: Reliability and Validity
Reliability & Validity
Human Resource Management By Dr. Debashish Sengupta
پرسشنامه کارگاه.
Part II Knowing How to Assess Chapter 5 Minimizing Error
Psychological Measurement: Reliability and the Properties of Random Errors The last two lectures were concerned with some basics of psychological measurement:
What do Samples Tell Us Variability and Bias.
Chapter 8 VALIDITY AND RELIABILITY
Presentation transcript:

MGTO 231 Human Resources Management Personnel selection I Dr. Kin Fai Ellick WONG

Questions for you The objective of selection is very simple: –Choosing the “correct” person However, we do not have magic, there are often many “incorrect choices” in our decisions A more realistic objective for selection seems to be: –Minimizing the probability of making an incorrect selection –How? I hope you will get some insights at the end of this class

Outline In Personnel selection I –The basic concepts –Measurement errors –Reliability In Personnel selection II –Validity –Selection tools Letter of recommendation, ability tests, personality tests, interviews, handwriting analysis, etc.

Outline Selection I Basic Concepts Measurement errors Reliability

Selection as prediction I want to have employees with good performance I cannot know their performance before hiring I can just predict from applicants’ various characteristics Some individuals are more likely to have better performance than others (remember the idea of individual differences)

What are the predictors Any characteristics associated with individual differences –Age, gender, IQ, EQ, interpersonal skills, education level, openness, extroversion, academic performance, etc. –Some may be better predictors than others (more reliable and valid)

All selection methods are to measure these characteristics and the associations between these characteristics with different aspects of performance Selection  individual characteristics  performance Tools  predictors  performance

Two major issues in selection –How consistent is the prediction (reliability) –How well is the prediction (validity) Is it really measuring what it is supposed to measure?

An example of a good and a bad predictor Y Academic Results Job Performance Y Interview’s rating Job Performance Which one has positive relationship with job performance?

Outline Selection I Basic Concepts Measurement errors Reliability

Measurement errors Please answer questions 1 and 2

Measurement errors Error is not equal to mistake Error is a kind of inaccuracy and variability Error can be reduced if the measuring device is precise, but it cannot be completely eliminated

Observed score = –True score + systematic errors + random errors Systematic errors –A constant is added to every measure –Observed score = True score + constant Random errors –A random value is added to every measure –The random values are normally distributed, with mean = 0 –Observed score = True score + random value

Sources of errors Systematic errors –Basic characteristics of the measuring device Random errors –Physical Temperature, humanity, loudness, brightness, etc. –Psychological Fatigue, motivation, adaptation to new environments –Sampling error domain sampling model

Outline Selection I Basic Concepts Measurement errors Reliability

Reliability ( 可靠度 ) Definition –(Textbook) The consistency of scores obtained by the same person when retested with the identical or equivalent tests

Measurement errors and reliability Which kind of errors, systematic or random, may affect the reliability of a measurement?

The purpose of testing –Assessing individual difference –The influence of systematic errors on this purpose is, everyone’s score is biased by a constant. The relative performance is unchanged Low T always gets low X, and high T always gets high X –The influence of random errors: Low T may obtain high X, and high T may obtain low X The probability of Low T getting high X increases as random error increases

What is a reliable measurement? A test that can truly reflect the “True score” is claimed as a reliable test For a perfectly reliable test –The correlation between the true score (T) and the observed score (X) is 1 –X can be fully accounted by T For a perfectly unreliable test –The correlation between T and X is 0 –T accounts for nothing about X

Tests that are relatively free of measurement (random) errors are deemed to be reliable There is much less concern with systematic errors The term “errors” usually refers to random errors

Which one is more reliable? –Tests that are relatively free of measurement random errors are deemed to be reliable –Reliability refers to consistency of measurement or repeatability TrialThermometer AThermometer BThermometer C

Methods measuring reliability Test-retest Parallel/alternate forms Split half Alpha (internal consistency)

How do you interpret this picture? –Please tell me a story about the picture Is this test reliable? –Why?

Conclusion I’ve asked: –A more realistic objective for selection seems to be: Minimizing the probability of making an incorrect selection How? Step 1:Using test with high reliability –Checking the reliability before and after using I’ll discuss the other step about “validity” in next lesson