Validity & Reliability Trustworthiness

Slides:

Advertisements

Similar presentations

Critical Reading Strategies: Overview of Research Process

Advertisements

ADDRESSING THE NEEDS OF TEACHERS IN DISADVANTAGED ENVIRONMENTS THROUGH STRATEGIES TO ENHANCE SELF-EFFICACY L A WOOD & TILLA OLIVIER.

Participant Observation

© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.

質性研究 Ma1c0112 林芳億. How is trustworthiness established Trustworthiness is established in a naturalistic inquiry by the use of techniques that provide.

Main Criticisms of Qualitative Research

Assessment criteria: Identification of key elements in the given paper, with reference to theories of learning; An evaluation of the trustworthiness of.

Social Research Methods

Research Methods Overview of quantitative and qualitative methods.

Reviewing and Critiquing Research

3 Standards for Sound Applied Linguistics Research  The qual–quant not only provides an interactive continuum useful for characterizing applied linguistics.

Reliability, Validity, Trustworthiness If a research says it must be right, then it must be right,… right??

Standards for Qualitative Research in Education

EDUC 894 Week 8. Plan for Today  Conference Debrief What’s Hot in Analysis Methods: Engaging Complexity  Group-work & Team Consultations Midterm Course.

Doing Social Psychology Research

SOWK 6003 Social Work Research Week 4 Research process, variables, hypothesis, and research designs By Dr. Paul Wong.

Introduction to research Analyzing and interpreting research data

Designing Case Studies. Objectives After this session you will be able to: Describe the purpose of case studies. Plan a systematic approach to case study.

Case Study Research By Kenneth Medley.

Classroom Assessment A Practical Guide for Educators by Craig A

Rosnow, Beginning Behavioral Research, 5/e. Copyright 2005 by Prentice Hall Ch. 6: Reliability and Validity in Measurement and Research.

Southampton Education School Southampton Education School Dissertation Studies Rigour, Ethics, & Risk.

Reliability & Validity Qualitative Research Methods.

Chapter 14 Overview of Qualitative Research Gay, Mills, and Airasian

McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. The Nature of Research Chapter One.

Qualitative Research.

Action Research March 12, 2012 Data Collection. Qualities of Data Collection  Generalizability – not necessary; goal is to improve school or classroom.

Bryman: Social Research Methods, 4 th edition What is a concept? Concepts are: Building blocks of theory Labels that we give to elements of the social.

V ALIDITY IN Q UALITATIVE R ESEARCH. V ALIDITY How accurate are the conclusions you make based on your data analysis? A matter of degree Non-reification.

Chapter 24 Trustworthiness and Integrity in Qualitative Research

WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.

Introduction to Research

Reliability and Validity Why is this so important and why is this so difficult?

URBDP 591 I Lecture 3: Research Process Objectives What are the major steps in the research process? What is an operational definition of variables? What.

McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. The Nature of Qualitative Research Chapter Eighteen.

1 Research Paper Writing Mavis Shang 97 年度第二學期 Section III.

Basic Qualitative Strategies Cap Peck, Research Question Beginning with less specific research questions Start with interests and a sense of the.

TRUSTWORTHINESS OF THE RESEARCH Assoc. Prof. Dr. Şehnaz Şahinkarakaş.

Sampling. Purpose of these readings? They should start sounding ‘familiar’ Evidence that you are learning! Several places to draw from in justifying your.

Truth value - credibility Applicability - transferability

Validity Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17)

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

JS Mrunalini Lecturer RAKMHSU Data Collection Considerations: Validity, Reliability, Generalizability, and Ethics.

McGraw-Hill/Irwin © 2012 The McGraw-Hill Companies, Inc. All rights reserved. Obtaining Valid and Reliable Classroom Evidence Chapter 4:

Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.

Educational Research Chapter 14 Overview of Qualitative Research

Chapter Nine: Qualitative Procedures

Section 1. Qualitative Research: Theory and Practice  Methods chosen for research dependant on a number of factors including:  Purpose of the research.

Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 20 Enhancing Quality and Integrity in Qualitative Research.

Analyzing & evaluating qualitative data Kim McDonough Northern Arizona University.

Inf st december Credibility: reliability and validity in qualitative research inf5220.

Reliability and Validity Why is this so important and why is this so difficult?

CRITICALLY APPRAISING EVIDENCE Lisa Broughton, PhD, RN, CCRN.

7/2/20161 Grounded Theory Saleema A. Gulzar MScN, BScN, BA, RN.

Evaluating Qualitative Study Leili Salehi Health education & Promotion Department Public health School Alborz University of Medical Sciences.

ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.

Elizabeth Visedo Independent Scholar ICQI Fri041

Chapter 6 Selecting a Design. Research Design The overall approach to the study that details all the major components describing how the research will.

How in the world is that valid & reliable?

Writing a sound proposal

Leacock, Warrican and Rose (2009)

Reliability and Validity in Research

The Research Process: Sport Coaching

Dealing with Validity, Reliability, and Ethics

Week 3 Class Discussion.

A Bit More About Qualitative Analysis

Trustworthiness in Qualitative Research

Topic 4: Learning Approach (Behaviourism)

Qualitative vs. Quantitative research

Overview of Qualitative Research Gay, Mills, and Airasian

Presentation transcript:

Validity & Reliability Trustworthiness EDUC 894 Week 6

Plan for Today Validity & Reliability Trustworthiness --------------------Dinner Break--------------------- Group-work Planning for Data Collection Informed Consent & Procedure Approval For Next Week: Data Collection (No Class) For Next Next Week Creswell Chapter 9 Glaser Article on Qualitative Data Analysis

Thorndike & Guba What is the overall issue that the concepts of reliability & validity or trustiworthiness are concerned with? Why are these issues critical to research? How does the idea of evaluating the plausibility of rival hypothesis occur in the naturalistic paradigm? How does it occur in the rationalistic paradigm?

The Overarching Issue Creating systematic safeguards that can give us confidence in knowing how we can rely on the results of our inquires. Table Source: Guba (1981) Criteria for Assessing the Trustworthiness of Naturalistic Inquiries

Thorndike What is the relationship between reliability & validity? Can you have reliability without validity? Can you have validity without reliability? Explain why or why not. Why can’t we talk about the reliability of an instrument in general? Why can’t we talk about the validity of an instrument in general? (note that the answers to these questions are different) Why don’t the concepts of reliability and validity “make sense” for researchers coming from a constructionist or subjectivist stance? How will you document reliability & validity in your study?

Instrument Reliability & Validity The accuracy or precision of a measurement procedure X = T + E Often thought of in terms of consistency Measured by correlation coefficients Validity The degree to which scores provide information that is relevant to the inferences to be made from them Content-related validity evidence Criterion-related validity evidence Construct related validity evidence

Study Validity Internal Validity External Validity The degree to which the particular situation studied represents the theoretical / conceptual structure that of interest External Validity The degree to which the particular situation studied generates findings that are relevant to other situations

Guba Why don’t the concepts of reliability and validity “make sense” for your research stance? What is the difference between validity and credibility? What is the different between generalizability and transferability? What is the difference between reliability and dependability? What is the difference between neutrality and objectivity? Which one will you show in your study and why? How will you document credibility, transferability, dependability and confirmability in your study?

Trustworthiness The Naturalistic Treatment Credibility (Results are Plausible) Triangulation Member Checks Prolonged Engagement / Persistent Observation Coherence / Discussion of alternative explanations Establish referential adequacy Transferability (Results are Context Relevant) Thick description Purposeful sampling Dependability (Results are Stable) Audit trail Overlapping Methods / Step-wise replication Confirmability (Results are Investigator-free) Reflexivity