Advanced Business Research Method Intructor : Prof. Feng-Hui Huang Agung D. Buchdadi DA21G201.

Slides:



Advertisements
Similar presentations
Chapter 8 Flashcards.
Advertisements

Part II Knowing How to Assess Chapter 5 Minimizing Error p115 Review of Appl 644 – Measurement Theory – Reliability – Validity Assessment is broader term.
Chapter 4 Validity.
Psychology 202b Advanced Psychological Statistics, II April 7, 2011.
VALIDITY.
MSc Applied Psychology PYM403 Research Methods Validity and Reliability in Research.
RELIABILITY consistency or reproducibility of a test score (or measurement)
When Measurement Models and Factor Models Conflict: Maximizing Internal Consistency James M. Graham, Ph.D. Western Washington University ABSTRACT: The.
Behavior in organization. Sociology and social psychology Field of organizational behavior psychology communication Political science Management science.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 5 Making Systematic Observations.
Chapter 2 – Tools of Positive Analysis
Psych 231: Research Methods in Psychology
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Correlational Designs
Chapter 5 Copyright © Allyn & Bacon 2008 This multimedia product and its contents are protected under copyright law. The following are prohibited by law:
Quantitative Research
Multivariate Analysis Techniques
Factors affecting contractors’ risk attitudes in construction projects: Case study from China 박병권.
Introduction to Survey Research. What kind of data can I collect? Factual Knowledge Factual Knowledge Cognitive Beliefs or Perceptions Cognitive Beliefs.
Qualitative Studies: Case Studies. Introduction l In this presentation we will examine the use of case studies in testing research hypotheses: l Validity;
The Characteristics of an Experimental Hypothesis
Experimental Research
Statistics for Education Research Lecture 10 Reliability & Validity Instructor: Dr. Tung-hsien He
Measurement in Exercise and Sport Psychology Research EPHE 348.
11 Reasons Why Manuscripts are Rejected
Understanding Statistics
Classroom Assessment A Practical Guide for Educators by Craig A
Chapter 1: Research Methods
Descriptive and Causal Research Designs
Evaluating a Research Report
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
Measuring Complex Achievement
HOW TO WRITE RESEARCH PROPOSAL BY DR. NIK MAHERAN NIK MUHAMMAD.
Correlational Research Chapter Fifteen Bring Schraw et al.
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
Chapter 1 Introduction to Statistics. Statistical Methods Were developed to serve a purpose Were developed to serve a purpose The purpose for each statistical.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 12 Correlational Designs.
Creswell, Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, 4e © 2012, 2008, 2005, 2002 Pearson Education,
Operational Definitions In our last class, we discussed (a) what it means to quantify psychological variables and (b) the different scales of measurement.
Controlling for Common Method Variance in PLS Analysis: The Measured Latent Marker Variable Approach Wynne W. Chin Jason Bennett Thatcher Ryan T. Wright.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 12 Making Sense of Advanced Statistical.
Model Selection and Validation. Model-Building Process 1. Data collection and preparation 2. Reduction of explanatory or predictor variables (for exploratory.
Chapter Seventeen. Figure 17.1 Relationship of Hypothesis Testing Related to Differences to the Previous Chapter and the Marketing Research Process Focus.
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
Copyright © Allyn & Bacon 2008 Intelligent Consumer Chapter 14 This multimedia product and its contents are protected under copyright law. The following.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
CHAPTER 2 Research Methods in Industrial/Organizational Psychology
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
© (2015, 2012, 2008) by Pearson Education, Inc. All Rights Reserved Chapter 11: Correlational Designs Educational Research: Planning, Conducting, and Evaluating.
The effects of Peer Pressure, Living Standards and Gender on Underage Drinking Psychologist- Kanari zukoshi.
Reliability performance on language tests is also affected by factors other than communicative language ability. (1) test method facets They are systematic.
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
Research Methods in Psychology Introduction to Psychology.
CHAPTER 1 THE FIELD OF SOCIAL PSYCHOLOGY. CHAPTER OBJECTIVES After reading this chapter, you should be able to: Offer a definition of social psychology.
Using Latent Variable Models in Survey Research Roger E. Millsap Arizona State University Contact: (480)
Multivariate Analysis - Introduction. What is Multivariate Analysis? The expression multivariate analysis is used to describe analyses of data that have.
Classroom Assessment A Practical Guide for Educators by Craig A
Multivariate Analysis - Introduction
THE FIELD OF SOCIAL PSYCHOLOGY
Chapter 4: Studying Behavior
CHAPTER 2 Research Methods in Industrial/Organizational Psychology
THE FIELD OF SOCIAL PSYCHOLOGY
Overview of Research Designs
Chapter Three Research Design.
BHS Methods in Behavioral Sciences I
Psy 425 Tests & Measurements
Multivariate Analysis - Introduction
Presentation transcript:

Advanced Business Research Method Intructor : Prof. Feng-Hui Huang Agung D. Buchdadi DA21G201

1. Introduction 2. Extent of Bias Caused by Common Method Variance 3. Potential Sources of Common Method Biases 4. Processes Through Which Method Biases Influence Respondent Behavior 5. Techniques for Controlling Common Method Biases 6. Comparison of Statistical Remedies for Common Method Biases 7. Recommendations for Controlling Method Biases in Research Settings 8. Some Additional Considerations 9. Conclusions

 Interest in the problem of method biases has a long history in the behavioral sciences.  The purpose of this article is to examine the extent to which method biases influence behavioral research results, identify potential sources of method biases, discuss the cognitive processes through which method biases influence responses to measures, evaluate the many different procedural and statistical techniques that can be used to control method biases, and provide recommendations for how to select appropriate procedural and statistical remedies for different types of research settings.

 Cote and Buckley (1987) found that approximately one quarter (26.3%) of the variance in a typical research measure might be due to systematic sources of measurement error like common method biases.  However, they also found that the amount of variance attributable to method biases varied considerably by discipline and by the type of construct being investigated.  For example, Cote and Buckley (1987) found that, on average, method variance was lowest in the field of marketing (15.8%) and highest in the field of education (30.5%).  They also found that typical job performance measures contained an average of 22.5% method variance, whereas attitude measures contain an average of 40.7%.  It is also noted that the CMV on controlled research is lower than CMV on uncontrolled research

 Cote and Buckley (1987) indicate that CMV can inflate or deflate the relationship between construct, as shown in table 1

 Method effects produced by a common source or rater

 Method effect produced by items context

 Method effect produced by measurement context

 Procedural Remedies 1. Obtain measures of the predictor and criterion variables from different sources 2. Temporal, proximal, psychological, or methodological separation of measurement a.Reducing biases in retrieval stage b.Reducing respondent ability to re”use” previous answer c.Reducing biases in the report stage 3. Protecting respondent anonymity and reducing evaluation apprehension

4. Counterbalancing question order 5. Improving scale items a.Define ambiguous or unfamiliar terms b.Avoid vague concepts and provide examples when such concepts must be used; c.Keep questions simple, specific, and concise; d.Avoid double-barreled questions; e.Decompose questions relating to more than one possibility into simpler, more focused questions; f. Avoid complicated syntax. g.eliminate item social desirability and demand characteristics

 Statistical Remedies 1. Herman’s single-factor test DescriptionExample Include all items from all of the construct in the study into a factor analysis to determine whether the majority of the variance can be accounted for by one general factor

 Statistical Remedies 2. Partial corellation procedure DescriptionExample Partialling out {social desirability or affectivity; an unrelated “marker variable”; a general method factor} as a surrogate for method variance

 Statistical Remedies 3. Controlling for the effect of a directly measured latent method factor

Statistical remedies 4. Controlling for the effects of an unmeasured latent method factor

5. Multiple method factors a. CFA of MTMM model

5. Multiple method factors b. Correlated uniqueness model

5. Multiple method factors c. Direct product model

 Controlling for Method Variance in Experimental Research Examining Mediated Effects Method biases contribute to observed relationship between the mediator and the dependent measure in this research as it is usually obtained from the same object at the same point Using single-common-method-factor approach

 Controlling for Method Variance in Studies Using Formative Constructs Since in formative construct the characteristic of indicators are different from those in reflective construct, To controll method bias, the researcher must be more careful in designing the research and the procedural controlls, then, are the best way in this matters.

 This paper provides the process to controll method bias in conducting research in behavior. The process starts by assesing the research setting to identify the potential sources of bias and then implementing both procedural and statistical methods of control.