Scenario-Based Scales Measuring Cultural Orientations of Business Owners Christine Koenig, Holger Steinmetz, Michael Frese, Andreas Rauch University of.

Slides:



Advertisements
Similar presentations
Multiple Regression.
Advertisements

Multiple group measurement invariance analysis in Lavaan
V.2 N.K. Bowen, GROUP 1 CONFIGURAL INVARIANCE AS TESTED WITH MPLUS INVARIANCE SHORTCUT (WLSMV) Loadings (except first) and thresholds free  = factor.
Applied Structural Equation Modeling for Dummies, by Dummies February 22, 2013 Indiana University, Bloomington Joseph J. Sudano, Jr., PhD Center for.
Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.
The Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI): A Cross-Cultural Validation Anita Welch, Claudette Peterson, Chris Ray,
Assessing measurement invariance in cross-cultural research Hans Baumgartner Penn State University.
Module 36: Correlation Pitfalls Effect Size and Correlations Larger sample sizes require a smaller correlation coefficient to reach statistical significance.
Growth Curve Model Using SEM
Developing and validating a stress appraisal measure for minority adolescents Journal of Adolescence 28 (2005) 547–557 Impact Factor: A.A. Rowley.
How to evaluate the cross-cultural equivalence of single items Melanie Revilla, Willem Saris RECSM, UPF Zurich – 15/16 July.
Psych 231: Research Methods in Psychology
Testing factorial invariance in multilevel data: A Monte Carlo study Eun Sook Kim Oi-man Kwok Myeongsun Yoon.
MEASUREMENT EQUIVALENCE OF NATIONALISM AND PATRIOTISM IN 34 COUNTRIES IN A COMPARATIVE PERSPECTIVE Eldad Davidov GESIS-Central Archive for Empirical Social.
Analyzing observed composite differences across groups: Is partial measurement invariance enough? Holger Steinmetz Faculty of Economics and Business Administration.
Assumption and Data Transformation. Assumption of Anova The error terms are randomly, independently, and normally distributed The error terms are randomly,
Correlation 1. Correlation - degree to which variables are associated or covary. (Changes in the value of one tends to be associated with changes in the.
Chapter 7 Correlational Research Gay, Mills, and Airasian
1 Measurement Adapted from The Research Methods Knowledge Base, William Trochim (2006). & Methods for Social Researchers in Developing Counries, The Ahfad.
Amber S. Emanuel 1, James A. Shepperd 2, Virginia J. Dodd 1 & Henrietta Logan 1 1 Department of Behavioral Sciences & Community Dentistry, University of.
Multiple Sample Models James G. Anderson, Ph.D. Purdue University.
© 2013 Cengage Learning. Outline  Types of Cross-Cultural Research  Method validation studies  Indigenous cultural studies  Cross-cultural comparisons.
Investigation of the Psychometric Properties of the Positivity Scale (P Scale) for Turkish Adolescents and Young Adults ACA-APCC 2015 Conference, Singapore.
Measurement in Exercise and Sport Psychology Research EPHE 348.
Issues in structural equation modeling Hans Baumgartner Penn State University.
Chapter 15 Correlation and Regression
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
2-1 MGMG 522 : Session #2 Learning to Use Regression Analysis & The Classical Model (Ch. 3 & 4)
Cultural Diversity and Workplace Dynamics: Jim Freeman and Graham Winch A Transmanche Link retrospective.
Cross-Cultural Research Methods. Methodological concerns with Cross-cultural comparisons  Equivalence  Response Bias  Interpreting and Analyzing Data.
Measurement Invariance of the Pediatric Version of PROMIS Symptom Scales between American and Chinese Children with Cancer Changrong Yuan 1,* , Pamela.
Multi-sample structural equation models with mean structures Hans Baumgartner Penn State University.
UNDERSTANDING RESEARCH RESULTS: DESCRIPTION AND CORRELATION © 2012 The McGraw-Hill Companies, Inc.
6. Evaluation of measuring tools: validity Psychometrics. 2012/13. Group A (English)
Confirmatory Factor Analysis Psych 818 DeShon. Construct Validity: MTMM ● Assessed via convergent and divergent evidence ● Convergent – Measures of the.
With or without constraints? An empirical comparison of two approaches to estimate interaction effects in the theory of planned behavior Eldad Davidov,
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Multigroup Models Byrne Chapter 7 Brown Chapter 7.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 12 Making Sense of Advanced Statistical.
Multigroup Models Beaujean Chapter 4 Brown Chapter 7.
G Lecture 7 Confirmatory Factor Analysis
Measurement Models: Identification and Estimation James G. Anderson, Ph.D. Purdue University.
Multivariate Analysis and Data Reduction. Multivariate Analysis Multivariate analysis tries to find patterns and relationships among multiple dependent.
Chapter 8: Simple Linear Regression Yang Zhenlin.
SECOND EDITION Chapter 5 Standardized Measurement and Assessment
Confirmatory Factor Analysis of Longitudinal Data David A. Kenny December
Principal Component Analysis
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 10: Correlational Research 1.
Research methods in Cross-cultural Psychology LECTURE 2.
Effects of unequal indicator intercepts on manifest composite differences Holger Steinmetz and Peter Schmidt University of Giessen / Germany.
Approaches of Model Specification for Testing Factor Mean Differences in Multi-group Higher-order CFA Model Jichuan Wang, Ph.D. Children’s National Medical.
Advanced Statistical Methods: Continuous Variables
Further Validation of the Personal Growth Initiative Scale – II: Gender Measurement Invariance Harmon, K. A., Shigemoto, Y., Borowa, D., Robitschek, C.,
Maher Abu-Hilal Sultan Qaboos University With Sahar Al-Abri
Ch. 5 Measurement Concepts.
The University of Manchester
Impact of Personal Value on Spectator Sport Consumption and Engagement in China Dr. Xiangren Yi Li Chen Shandong University.
Dr. Siti Nor Binti Yaacob
Psychometric Properties of the Seeking of Noetic Goals Test Brandy J
Evaluation of measuring tools: validity
HLM with Educational Large-Scale Assessment Data: Restrictions on Inferences due to Limited Sample Sizes Sabine Meinck International Association.
Making Sense of Advanced Statistical Procedures in Research Articles
Modelos para datos longitudinales
Dr. Chin and Dr. Nettelhorst Winter 2018
The University of Manchester
Holger Steinmetz Dep. of Work and Organizational Psychology
Principal Component Analysis
Confirmatory Factor Analysis
15.1 The Role of Statistics in the Research Process
Descriptive Statistics
Presentation transcript:

Scenario-Based Scales Measuring Cultural Orientations of Business Owners Christine Koenig, Holger Steinmetz, Michael Frese, Andreas Rauch University of Giessen, Germany Zhong-Ming Wang University of Zhejiang, China

2 Introduction  The scales differ from other scales commonly used in cross-cultural research: -Instead of measuring culture at the aggregate level, the scales measure cultural orientations at the individual level. -Instead of being based on Likert items, the scales are based on scenarios.

3 Individual-Level Measurement  Cross-cultural studies on individual business owners should measure cultural orientations rather than culture.  Cultural orientations are manifested in practices and values of individuals.  Among the manifestation of cultural orientations, we consider practices to be more relevant for studying business owners than values.

4 Individual-Level Measurement  We are not aware of any cultural orientation scales measuring practices that are suitable for business owners.  Therefore, we developed cultural orientation scales that measure the practices owners apply in their businesses.

5 Individual-Level Measurement  The scales measure seven cultural orientations: -uncertainty avoidance -power distance -collectivism -assertiveness -future orientation -humane orientation -performance orientation

6 Scenario-Based Measurement  Cultural orientations should be measured using scales based on scenarios rather than using scales based on Likert items.  Likert items and scenarios differ in the measurement of cultural orientations.

7 Scenario-Based Measurement  Scales based on Likert items tend to hold lower cross- cultural validity than scales based on scenarios: -Likert items are more likely to be interpreted differently by people from different cultures than scenarios. -Likert items are more affected by the reference group effect than scenarios.

8 Development  We developed the cultural orientation scales in a team of Chinese and German researchers.  We created scenarios that consist of social situations and behavioral options.  The social situations describe problems owners may encounter in their businesses.  Each of the social situations represents one of the cultural orientations.

9 Development  The behavioral options describe behaviors owners may show to solve the problems.  The first option represents of low score on the cultural orientation, whereas the second option represents a high score.  Between the two behavioral options, there are two mirror-inverted three-point scales.

10 Sample Scenario

11 Participants  Among the 461 owners who completed the scales, were 260 Chinese and 201 German owners.  They were not only owners but also managers of their businesses and had at least one employee.  Their businesses belonged to information technology, hotel and catering, automobile, or construction industry.

12 Cross-Cultural Validation  To ascertain whether the cultural orientation scales hold cross-cultural validity, we tested five forms of invariance: -configural invariance -metric invariance -scalar invariance -factor variance invariance -error invariance

13 Configural Invariance  The model of configural invariance comprised 23 scenarios that measured the seven cultural orientations.

14 Model

15 Configural Invariance  The model of configural invariance comprised 23 scenarios that measured the seven cultural orientations.  The model of configural invariance provided adequate fit (Chi 2 (418) = ; RMSEA =.044; CFI =.94).

16 Metric Invariance  The factor loadings were constrained to be equal across the Chinese and the German samples.  The model of full metric invariance achieved adequate fit (Chi 2 (434) = ; RMSEA =.044; CFI =.93).

17 Scalar Invariance  The item intercepts were restricted to be equal across the Chinese and the German samples.  The model of partial scalar invariance achieved adequate fit (Chi 2 (446) = ; RMSEA =.044; CFI =.93).  Given metric and scalar invariance, the means of the seven cultural orientations can be meaningfully compared across both samples (Steenkamp & Baumgartner,1998).

18 Factor Variance Invariance  The factor variances were constrained to be equal across the Chinese and the German samples.  The model of partial factor variance invariance provided adequate fit (Chi 2 (451) = ; RMSEA =.044; CFI =.93).  Given metric and partial factor variance invariance, different covariances can be interpreted as different correlations for the remaining five cultural orientations (Marsh & Hocevar, 1985).

19 Error Variance Invariance  The error variances were restricted to be equal across the Chinese and the German samples.  The model of partial error variance invariance achieved adequate fit (Chi 2 (463) = ; RMSEA =.044; CFI =.93).  Given metric and factor variance invariance, this result implies that the Chinese sample showed a lower reliability in half of the scenarios.

20 Conclusion  All five forms of invariance were at least partially supported.  Given metric and scalar invariance, the means of the seven cultural orientations can be meaningfully compared across the Chinese and the German samples.  Given metric and factor variance invariance, different covariances can be interpreted as different correlations – except for uncertainty avoidance and assertiveness.  Given metric invariance, regression coefficients can be compared across the Chinese and the German samples.

Thank you very much for your attention.