Suppose you are a researcher who is interested in the effects of diet and exercise on blood pressure levels of males and females age 30-40. How could.

Slides:



Advertisements
Similar presentations
The Research Consumer Evaluates Measurement Reliability and Validity
Advertisements

Types of Reliability.
VALIDITY AND RELIABILITY
Validity and Reliability
Reliability and Validity of Research Instruments
EPIDEMIOLOGY AND BIOSTATISTICS DEPT Esimating Population Value with Hypothesis Testing.
Reliability and Validity in Experimental Research ♣
Concept of Measurement
Statement of the Problem Goal Establishes Setting of the Problem hypothesis Additional information to comprehend fully the meaning of the problem scopedefinitionsassumptions.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Research Methods in MIS
Reliability of Selection Measures. Reliability Defined The degree of dependability, consistency, or stability of scores on measures used in selection.
WEEK 1 – TOPIC 1 OVERVIEW OF ASSESSMENT: CONTEXT, ISSUES AND TRENDS 1.
Chapter 2 Understanding the Research Process
TRENDS AND ISSUES IN NURSING TRENDS AND ISSUES IN NURSINGNUR487 Overview of research process I. Basic Research Terminology Dr. Nazik Zakari Dr. Hanan A.
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Technical Issues Two concerns Validity Reliability
Experimental Design The Gold Standard?.
Validity and Reliability Dr. Voranuch Wangsuphachart Dept. of Social & Environmental Medicine Faculty of Tropical Medicine Mahodil University 420/6 Rajvithi.
Bob Vialpando & Randy Grove. Subject Area: Statistics.
Reliability and Validity what is measured and how well.
Instrumentation.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Data Analysis. Quantitative data: Reliability & Validity Reliability: the degree of consistency with which it measures the attribute it is supposed to.
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
Induction to assessing student learning Mr. Howard Sou Session 2 August 2014 Federation for Self-financing Tertiary Education 1.
V ALIDITY IN Q UALITATIVE R ESEARCH. V ALIDITY How accurate are the conclusions you make based on your data analysis? A matter of degree Non-reification.
Collecting Quantitative Data
Introduction to Statistics What is Statistics? : Statistics is the sciences of conducting studies to collect, organize, summarize, analyze, and draw conclusions.
Measuring and Collecting Data. Measurement Researchers spend a lot of time describing research variables Level of measurement: important for statistical.
Creating Assessments AKA how to write a test. Creating Assessments All good assessments have three key features: All good assessments have three key features:
Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 4:Reliability and Validity.
Forming the Method Subjects Instruments or apparatus Procedures Design and analysis The Method section explains how the study was conducted and should.
EDU 8603 Day 6. What do the following numbers mean?
Independent vs Dependent Variables PRESUMED CAUSE REFERRED TO AS INDEPENDENT VARIABLE (SMOKING). PRESUMED EFFECT IS DEPENDENT VARIABLE (LUNG CANCER). SEEK.
Behavioral Assessment ã Selection and Definition of Target Behaviors ã Selection of a Measurement Device ã Recording behavior (Collection of Data) ã Assessment.
Evaluating Impacts of MSP Grants Hilary Rhodes, PhD Ellen Bobronnikov February 22, 2010 Common Issues and Recommendations.
Evaluating Impacts of MSP Grants Ellen Bobronnikov Hilary Rhodes January 11, 2010 Common Issues and Recommendations.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Reliability Ability to produce similar results when repeated measurements are made under identical conditions. Consistency of the results Can you get.
Donna B. Konradi, DNS, RN, CNE GERO 586 Populations and Samples.
DENT 514: Research Methods
Psychology 3051 Psychology 305A: Theories of Personality Lecture 2 1.
Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.
Reliability When a Measurement Procedure yields consistent scores when the phenomenon being measured is not changing. Degree to which scores are free of.
Reliability EDUC 307. Reliability  How consistent is our measurement?  the reliability of assessments tells the consistency of observations.  Two or.
R EPORT WRITING Purpose Help the reader understand a situation and make a decision on any action that may be necessary to improve matters 1.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 1 Statistics: The Art and Science of Learning from Data Section 1.1 Using Data to Answer.
Dr. Jeffrey Oescher 27 January 2014 Technical Issues  Two technical issues  Validity  Reliability.
SECTION 1 TEST OF A SINGLE PROPORTION
Descriptive and Inferential Statistics Descriptive Statistics – consists of the collection, organization, and overall summery of the data presented. Inferential.
Inter-Rater or Inter- Observer Reliability. Description Is the extent to which two or more individuals (coders or raters) agree. Inter- Rater reliability.
Data Collection Methods NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Lecture 5 Validity and Reliability
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
Reliability & Validity
Chapter 2 Sociological Research Methods
Measurement Characteristics of Client Assessment
Analyzing Reliability and Validity in Outcomes Assessment Part 1
Competency 007: E.
Collecting and Interpreting Quantitative Data – Introduction (Part 1)
When Tests Fail Engineering Design and Development
The first test of validity
Basic Concepts in Social Science Research
Analyzing Reliability and Validity in Outcomes Assessment
Qualities of a good data gathering procedures
Presentation transcript:

Suppose you are a researcher who is interested in the effects of diet and exercise on blood pressure levels of males and females age How could you obtain blood pressure readings from your subjects?

Collect Data Analyze Data Report Results/Make Decisions Possible reasons for the observed results? Treatment was effective There were pre-existing differences between the groups. Poor instrumentation Treatment (or control) was not implemented correctly It was a fluke (e.g., chance)

Reliability: Does your measuring device produce consistent results? Validity: Does your measuring device produce accurate results? Instrument: A test or other tool that is used to collect data Instrumentation

Reliability is a necessary but not sufficient condition for validity

Types of Reliability Stability Equivalency Internal Consistency Interrater Interobserver Types of Validity ContentConstruct PredictiveConcurrent

Types of Reliability Stability Equivalency Internal Consistency Interrater Interobserver

Types of Validity ContentPredictive ConstructConcurrent

Characteristics of reliability and validity They are a matter of degree The estimates are specific to groups Validity is specific to the interpretation/context

Locating Existing Instruments Tests in Print Mental Measurements Yearbook Test Critiques