Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research © 2014 John Wiley & Sons, Inc. All rights reserved.

Slides:

Advertisements

Similar presentations

Chapter 3 Introduction to Quantitative Research

Advertisements

Chapter 3 Introduction to Quantitative Research

1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.

© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.

VALIDITY AND RELIABILITY

Research Methodology Lecture No : 11 (Goodness Of Measures)

Copyright © Allyn & Bacon (2007) Hypothesis Testing, Validity, and Threats to Validity Graziano and Raulin Research Methods: Chapter 8 This multimedia.

5/15/2015Marketing Research1 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g. measuring height ◦ or weight.

Reliability, Validity, Trustworthiness If a research says it must be right, then it must be right,… right??

Operationalizing Concepts Issues in operationally defining your concepts, validity, reliability and scales.

RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.

Reliability and Validity Dr. Roy Cole Department of Geography and Planning GVSU.

RELIABILITY & VALIDITY

Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.

Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.

Psych 231: Research Methods in Psychology

SELECTION & ASSESSMENT SESSION THREE: MEASURING THE EFFECTIVENESS OF SELECTION METHODS.

Chapter 5 Measuring Variables. DESCRIBING VARIABLES Correspondence Standardization Quantification Duplication.

Validity, Reliability, & Sampling

Research Methods in MIS

Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.

Understanding Validity for Teachers

Introduction to Theory & Research Design

EDRS6208 Lecture Three Instruments and Instrumentation Data Collection.

Planning an Applied Research Project Chapter 1 – Reading and Analyzing Research © 2014 John Wiley & Sons, Inc. All rights reserved.

McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. The Nature of Research Chapter One.

Chapter 9 Qualitative Data Analysis Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.

Ch 6 Validity of Instrument

Planning an Applied Research Project Chapter 2 – Developing an Interest or Topic © 2014 by John Wiley & Sons, Inc. All rights reserved.

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

Bryman: Social Research Methods, 4 th edition What is a concept? Concepts are: Building blocks of theory Labels that we give to elements of the social.

Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.

Planning an Applied Research Project Chapter 7 – Forms of Quantitative Research © 2014 John Wiley & Sons, Inc. All rights reserved.

WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.

Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.

The Basics of Experimentation Ch7 – Reliability and Validity.

Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.

Planning an Applied Research Project Chapter 8 – Sampling Issues in Research © 2014 John Wiley & Sons, Inc. All rights reserved.

URBDP 591 I Lecture 3: Research Process Objectives What are the major steps in the research process? What is an operational definition of variables? What.

Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.

Planning an Applied Research Project Chapter 3 – Conducting a Literature Review © 2014 by John Wiley & Sons, Inc. All rights reserved.

Chapter 4 – Research Methods in Clinical Psych Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.

Measurement Validity.

Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.

Planning an Applied Research Project Chapter 12 – Research Techniques: Observation, Focus Groups, and Other Techniques © 2014 John Wiley Sons, Inc. All.

Validity and Reliability Neither Valid nor Reliable Reliable but not Valid Valid & Reliable Fairly Valid but not very Reliable Think in terms of ‘the purpose.

Evaluating Survey Items and Scales Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.

Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.

Reliability & Validity  Reliability  “dependability”  is the indicator consistent?  same result every time?  Does not necessary measure what you think.

Measurement and Scaling

Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.

Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.

11 Chapter 4 The Research Process – Theoretical Framework – (Stage 3 in Research Process) © 2009 John Wiley & Sons Ltd.

Chapter 6 - Standardized Measurement and Assessment

Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.

Dr. Jeffrey Oescher 27 January 2014 Technical Issues  Two technical issues  Validity  Reliability.

Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.

Assist. Prof. Merve Topcu Department of Psychology, Çankaya University

Chapter 2 Theoretical statement:

Constructing hypotheses & research design

Planning an Applied Research Project

Research Study.

Reliability and Validity in Research

Associated with quantitative studies

Social Research Methods MAN-10 Erlan Bakiev, Ph. D.

Part Two THE DESIGN OF RESEARCH

Reliability & Validity

Reliability & Validity

Group Experimental Design

Misc Internal Validity Scenarios External Validity Construct Validity

Presentation transcript:

Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research © 2014 John Wiley & Sons, Inc. All rights reserved.

Learning Objectives »Explain what a scholarly article is »Differentiate between CPR and LOAF elements of a scholarly articles »Analyze the relative merits of various scholarly articles »Use various search engines to find scholarly articles »Identify an area of research interest »Discriminate between scholarly articles and other publications © 2014 John Wiley & Sons, Inc. All rights reserved.

Key Terms »Concurrent validity »Convergent validity »Construct validity »Content validity »Criterion validity »Credibility »Dependent variable »Discriminant validity »Equivalent form reliability »External validity »Face validity »General validity »Golem effect »Independent variable »Instrumentation »Instrument validity »Internal consistency reliability © 2014 John Wiley & Sons, Inc. All rights reserved.

Key Terms(cont’d) ˃ Internal validity ˃ Intervening variable ˃ Inter-rater reliability ˃ Moderating variable ˃ Operational definition ˃ Predictive validity ˃ Pygmalion effect ˃ Reliability ˃ Testing ˃ Test-retest reliability © 2014 John Wiley & Sons, Inc. All rights reserved.

Internal Credibility »Believability »Trustworthiness »Specificity © 2014 John Wiley & Sons, Inc. All rights reserved.

Validity »Content validity »Face validity »Construct validity »Criterion validity »Predictive validity »Discriminant validity © 2014 John Wiley & Sons, Inc. All rights reserved.

Variables »Independent variable »Dependent variable »Confounding (moderating) variable »Intervening variable »Operationalizing the variables © 2014 John Wiley & Sons, Inc. All rights reserved.

Validity InternalExternal »General validity »Instrumental validity »To what extent can you apply the insights to other situations? © 2014 John Wiley & Sons, Inc. All rights reserved.

Internal Validity ˃ To what extent is your research design really focused on the problem statement you have? ˃ Will you collect and analyze relevant and accurate information? ˃ How can you be sure that your design answers your research questions? ˃ What aspects of the design can you create to ensure validity? © 2014 John Wiley & Sons, Inc. All rights reserved.

Forms of Instrument Validity »Content validity »Construct validity »Criterion validity »Discriminant validity »Face validity »Predictive validity © 2014 John Wiley & Sons, Inc. All rights reserved.

External Validity »To what extent does the literature review place your expected findings within a broader context? »Will you be able to generalize from what you find? »What limitations or qualifications will you have to make about your results? »How can you extend your findings and suggest opportunities for further research so that you protect its validity? »How does previous research help you interpret your results? »Does previous research provide a rationale for your research design and suggestions about the applicability of your findings? © 2014 John Wiley & Sons, Inc. All rights reserved.

Threats to Validity »Ambiguity »History »Instrumentation »Mortality »Maturation »Testing © 2014 John Wiley & Sons, Inc. All rights reserved.

Reliability »Types ˃ Equivalent form reliability ˃ Internal consistency reliability ˃ Inter-rater reliability ˃ Test-retest reliability © 2014 John Wiley & Sons, Inc. All rights reserved.

Review of Class Session »Anything unclear? »One thing that I was amazed by in sampling is … © 2014 John Wiley & Sons, Inc. All rights reserved.