Assessing managerial career success development and validation of a new extrinsic measure Nicky Dries* and Roland Pepermans Presented at the 26th International.

Slides:



Advertisements
Similar presentations
Chapter 8 Flashcards.
Advertisements

Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
Chapter 5 Measurement, Reliability and Validity.
Part II Sigma Freud & Descriptive Statistics
RESEARCH METHODS Lecture 18
Chapter 4 Validity.
The Role of Organisational Commitment in the Analysis of Resistance to Change: Direct, Mediating or Moderator Effects?
Concept of Measurement
Reliability and Validity
Match line A to one of the three on the left. What percentage of people went along?
Maria Cristina Matteucci, Dina Guglielmi
Chapter 2 Research Process Part 1: Aug 29, Research Methods Importance of scientific method Research Process – develop ideas, refine ideas, test.
Chapter 7 Correlational Research Gay, Mills, and Airasian
Chapter 7 Evaluating What a Test Really Measures
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
CORRELATIO NAL RESEARCH METHOD. The researcher wanted to determine if there is a significant relationship between the nursing personnel characteristics.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
Measurement in Exercise and Sport Psychology Research EPHE 348.
Conducting a User Study Human-Computer Interaction.
PowerPoint presentation to accompany Research Design Explained 6th edition ; ©2007 Mark Mitchell & Janina Jolley Chapter 7 Introduction to Descriptive.
Diagnosis of safety culture: A replication and extension towards assessing "safe" organizational change processes Gudela Grote Professor of Work and Organizational.
Instrumentation.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Chapter 18 Some Other (Important) Statistical Procedures You Should Know About Part IV Significantly Different: Using Inferential Statistics.
1 EPSY 546: LECTURE 1 INTRODUCTION TO MEASUREMENT THEORY George Karabatsos.
Statistical analysis Prepared and gathered by Alireza Yousefy(Ph.D)
Chapter 4: Test administration. z scores Standard score expressed in terms of standard deviation units which indicates distance raw score is from mean.
26/05/20081Work, organizational and personnel psychology Predicting multidimensional entrepreneurial success from personality Vantilborgh Tim, Joly Jeroen,
Assessing the Quality of Research
By Cao Hao Thi - Fredric W. Swierczek
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Measurement Validity.
EPSY 546: LECTURE 3 GENERALIZABILITY THEORY AND VALIDITY
1 The Impact of Knowledge Sharing Modes and Projects Complexity on Team Creativity in Taiwan ’ s Information Systems Development Team 1 Mei-Hsiang Wang.
Qualitative or quantitative?. Research methods and statistics We are learning about...We are learning how to... Qualitative and quantitative data. Content.
Types of Validity Content Validity Criterion Validity Construct Validity Predictive Validity Concurrent Validity Convergent Validity Discriminant Validity.
CHAPTER OVERVIEW The Measurement Process Levels of Measurement Reliability and Validity: Why They Are Very, Very Important A Conceptual Definition of Reliability.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Chapter 4 Validity Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
Validity and Item Analysis Chapter 4. Validity Concerns what the instrument measures and how well it does that task Not something an instrument has or.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)
Chapter Eight: Quantitative Methods
SECOND EDITION Chapter 5 Standardized Measurement and Assessment
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
©2005, Pearson Education/Prentice Hall CHAPTER 6 Nonexperimental Strategies.
Jump to first page Inferring Sample Findings to the Population and Testing for Differences.
Beginners statistics Assoc Prof Terry Haines. 5 simple steps 1.Understand the type of measurement you are dealing with 2.Understand the type of question.
MULTIVARIATE ANALYSIS. Multivariate analysis  It refers to all statistical techniques that simultaneously analyze multiple measurements on objects under.
- Nicky Dries - Different ladder, different story? VU – UVA session June 4th, 2009 Building talent management theory within a postmodern career framework.
© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.
Selecting the Best Measure for Your Study
Hypothesis Testing.
Questions What are the sources of error in measurement?
Concept of Test Validity
Measurement: Part 1.
High-potential careers: Whose track is it anyway
Evaluation of measuring tools: validity
Understanding Results
SAINT LOUIS UNIVERSITY
Nicky Dries & Roland Pepermans
Week 3 Class Discussion.
Reliability and Validity of Measurement
RESEARCH METHODS Lecture 18
Week 11 Slides.
Presentation transcript:

Assessing managerial career success development and validation of a new extrinsic measure Nicky Dries* and Roland Pepermans Presented at the 26th International Congress of Applied Psychology in Athens, Greece on July 19th 2006

MCSM July 19th 2006 | pag. 2 Introduction valid measures? Objective/External personality socio-demographics human capital motivation networking mentoring gender … career success antecedents societal/organizational norms social vision Subjective/Internal personal norms ideosyncratic vision functional level promotions salary salary progression career satisfaction

MCSM July 19th 2006 | pag. 3 Content validity issues with commonly used measures of objective career success (a) be objective i.e. observable and measurable (b) reflect an external norm i.e. be grounded in shared social understanding (c) include all criteria relevant to the construct of objective career success MEASURECONTENT VALIDITY Functional level & Promotions (a) are observable & measurable (b) reflect an external norm (c) absolute measures > inter-organizational comparison? relative measures > speed of career advancement? positive relationship with tenure and age? Salary & Salary progression (a) are observable & measurable (b) reflect an external norm (c) gender, race, educational level, tenure, sector … > internal validity? low item response rates > usability? Interpretation requires additional information « Financial success »

MCSM July 19th 2006 | pag. 4 Development of the MCSM (1) Level indicator (L) 0 ≤ L ≤ 1 l i = 1 → L = 0 l i = l max → L = 1 Theoretical properties

MCSM July 19th 2006 | pag. 5 Development of the MCSM (2) Tenure indicator (Y) 1/45 ≤ Y ≤ 1 y i = y max → Y = 1/45 y i = 1 → Y = 1 Theoretical properties

MCSM July 19th 2006 | pag. 6 Development of the MCSM (3) Mobility indicator (M) 1/ l max ≤ M ≤ 1 l i = l s → M = 1/ l max l i = l max ^ l s = 1 → M = 1 Theoretical properties

MCSM July 19th 2006 | pag. 7 Development of the MCSM (4) Managerial Career Success Measure (MCSM) 0 ≤ MCSM ≤ 100 l i = l s = 1 → MCSM = 0 l s = 1 ^ l i = l max ^ y i = 1 → MCSM = 100 Theoretical properties

MCSM July 19th 2006 | pag. 8 Content validation of the MCSM (a) is the MCSM an objective measure? objective information > personnel records > what about self-report? (b) does the rationale behind the MCSM reflect an external norm about what career success entails? “a maximal number of upward career moves within a minimal amount of time” ≈ fast-track careers, high-potential careers > organizational norms ≈ functional level + promotions + speed of advancement > societal norms (c) does the MCSM measure the full domain implied by its label? MCSM ≠ intended to be used on its own! factual information ≠ self-serving bias ≠ common method variance correspondence self-report – archival data? objective/external: MCSM subjective/internal: career satisfaction financial: salary & salary progression

MCSM July 19th 2006 | pag. 9 Construct validation of the MCSM: method managerial sample (N = 1458)  59% are men, 41% are women  69% are over 36 years old  41% work in the services industry  40% are in human resources  53% have a master’s degree procedure  online surveys (3 studies)  snowball sampling INDEPENDENTSDEPENDENTSOPERATIONALIZATIONS genderobjective career successMCSM tenuresubjective career successCareer Satisfaction Scales educational levelfunctional levellili agesalarycurrent net month salary (s i ) sectorsalary progressions i – managerial net month starting salary (s s ) categorical variables!(except tenure) Greenhaus, Parasuraman & Wormley (1990)

MCSM July 19th 2006 | pag. 10 Construct validation of the MCSM: hypotheses & results H1: Convergent validity – correlational approach MCSM - functional level - salary - salary progression - career satisfaction H2: Convergent validity – contrasted groups approach MCSM: men – women higher managerial levels – lower managerial levels H3: Discriminant validity Tenure Educational level MCSM Age Sector r =.29, p < 0.01 r =.12, p < 0.05 r =.21, p < 0.01 Pearson correlations t (1096) = 4.57, p = 0.00 F (2,, 1098) = 66.49, p = 0.00 Independent-samples t test ANOVA  gender > MCSM = zero or not zero: z (1) = 25.23, p =0.00  none > MCSM = not zero: R² =.02, F(9,711) = 1.65, ns  gender, tenure, educational level > functional level (R² =.08)  gender, tenure, educational level, age, sector > salary (R² =.13)  gender, tenure > salary progression (R² =.26)  tenure, educational level > career satisfaction (R² =.03) Binary logistic regression Hierarchical multiple regression All hypotheses accepted

MCSM July 19th 2006 | pag. 11 Content validity Construct validity Implications for future research  Internal validity: what are the true causes of career success (disregarding confounding variables)?  External validity: can the conclusions of our study be generalized? Discussion « career success » MCSM Career Satisfaction Salary tenure educational level age sector MCSM functional level promotions salary salary increase subjective career success (gender) performance, competencies, traits, commitment… To another sample? To another place? To another time?

MCSM July 19th 2006 | pag. 12 Any questions? downloads available at starting August 2006