Precision, Accuracy, And Validity

Slides:



Advertisements
Similar presentations
Evaluating and Institutionalizing
Advertisements

Chapter 8 Flashcards.
Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Research Curriculum Session II –Study Subjects, Variables and Outcome Measures Jim Quinn MD MS Research Director, Division of Emergency Medicine Stanford.
The Research Consumer Evaluates Measurement Reliability and Validity
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Beginning the Research Design
Psych 231: Research Methods in Psychology
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
How Science Works Glossary AS Level. Accuracy An accurate measurement is one which is close to the true value.
Validity, Reliability, & Sampling
Chapter 6 Variance And Covariance. Studying sets of numbers as they are is unwieldy. It is usually necessary to reduce the sets in two ways: (1) by calculating.
1 Measurement Adapted from The Research Methods Knowledge Base, William Trochim (2006). & Methods for Social Researchers in Developing Counries, The Ahfad.
Validity and Reliability Dr. Voranuch Wangsuphachart Dept. of Social & Environmental Medicine Faculty of Tropical Medicine Mahodil University 420/6 Rajvithi.
Sampling : Error and bias. Sampling definitions  Sampling universe  Sampling frame  Sampling unit  Basic sampling unit or elementary unit  Sampling.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Teaching Registrars Research Methods Variable definition and quality control of measurements Prof. Rodney Ehrlich.
Measurement in Medicine. Lord Kelvin When you can measure what you are speaking about, and express it in numbers, you know some thing about it; but when.
CSD 5100 Introduction to Research Methods in CSD Observation and Data Collection in CSD Research Strategies Measurement Issues.
Module 4 Notes Research Methods. Let’s Discuss! Why is Research Important?
Measurement Validity.
Evidence Based Medicine Week 2: Basic Research Concepts in Western and Eastern Medicine.
Botkin & Keller Environmental Science 5/e Chapter 2 Science as a Way of Knowing.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Nurhayati, M.Pd Indraprasta University Jakarta.  Validity : Does it measure what it is supposed to measure?  Reliability: How the representative is.
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Errors. Random Errors A random error is due to the effects of uncontrolled variables. These exhibit no pattern. These errors can cause measurements to.
3/3/2016Copyright Ed Lipinski and Mesa Community College, All rights reserved. 1 Research Methods Summer 2009 Making Systematic Observations.
Steps in the Scientific Method 1.Observations - quantitative - qualitative 2.Formulating hypotheses - possible explanation for the observation 3.Performing.
CHAPTER 1 THE FIELD OF SOCIAL PSYCHOLOGY. CHAPTER OBJECTIVES After reading this chapter, you should be able to: Offer a definition of social psychology.
Survival Skills for Researchers Study Design. Typical Process in Research Design study Generate hypotheses Develop tentative new theories Analyze & interpret.
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Survey Methodology Reliability and Validity
Clinical practice involves measuring quantities for a variety of purposes, such as: aiding diagnosis, predicting future patient outcomes, serving as endpoints.
Ch. 5 Measurement Concepts.
QUESTIONNAIRE DESIGN AND VALIDATION
MODULE 2 Myers’ Exploring Psychology 5th Ed.
Reliability and Validity
Experiment Basics: Variables
Reliability and Validity in Research
THE FIELD OF SOCIAL PSYCHOLOGY
Comparing Theory and Measurement
RELIABILITY OF QUANTITATIVE & QUALITATIVE RESEARCH TOOLS
THE FIELD OF SOCIAL PSYCHOLOGY
Module 02 Research Strategies.
Samples or groups for comparison
IN THE NAME OF GOD.
Unit IX: Validity and Reliability in nursing research
RESEARCH METHODS Lecture 18
Evaluating and Institutionalizing OD Interventions
The Certified Quality Engineer Handbook 3rd ed. Ch
Philip G. Zimbardo Robert L. Johnson Ann L. Weber
Experiment Basics: Variables
Scientific Method Steps
Chapter 11: Measuring Research Variables
Lecture 1: Descriptive Statistics and Exploratory
Measurement Concepts and scale evaluation
Research Strategies.
Bias, Confounding and the Role of Chance
Experimental Design.
Copyright © Allyn & Bacon 2007
The Certified Quality Engineer Handbook 3rd ed. Ch
Principles of Experimental Design
Qualities of a good data gathering procedures
EC 217 MEASUREMENTS AND INSTRUMENTATION
Reliability Vs. Validity by
Presentation transcript:

Precision, Accuracy, And Validity Precision:- a very precise measurement is a one that has nearly the same value each time it is measured. A scale measurement is more precise than a qualitative one. The more precise a measurement the greater the statistical power. Assessing precision: usually by S.D.of repeated measurements, also the Co.V. or correlation coefficient.

Precision is usually affected by random errors, there are 2 main sources of errors: Subjective:- subject variability due to intrinsic biological variability ex.: fluctuation in mood, B.Pr., heart rate… Objective : 1- Observer: hand-eye coordination 2- Instruments: due to fluctuating environmental factors such as temperature, background noise,…

Strategies For enhancing precision: Through decreasing random errors, and this is done by: 1- Standardizing the measurement method 2- Training & certifying the observer 3- Refining the instruments 4- Automating the instruments 5- Repetition: repeat the measurement & use the mean

Accuracy The accuracy of a variable is the degree to which it actually represents what it is intended to represent. Precision Accuracy Definition Best way to use threatened by The degree to which a variable has nearly the same value when measured several times. Comparison among repeated measures Random error( chance) subjective and objective The degree to which a variable actually represents what it is supposed to comparison with a reference standard systematic error (bias) subjective & objective

Accuracy is affected by systematic errors (bias) of two types: 1- Subjective: Co-operation, re-call, illiteracy… 2- Objective : -observer: conscious or un-conscious -Instruments: which are not calibrated recently. .

Strategies for enhancing accuracy: The same 1-4 strategies of precision and : 5- Making unobtrusive measures: design measurements that the observer is unaware of. 6- Blinding: Single, double, triple (the researcher or the manager who is reading the outcome) 7- Calibrating the instruments The discussion on how vigorously to peruse each of these strategies depends on feasibility and cost of the strategy

Validity Predictive Validity: the degree to which the measurement successfully predicts an outcome Criterion related Validity: the degree to which the measurement agrees with other approaches for measuring the same characteristics (ex. Question about stress) Face Validity: a subjective judgment whether a measurement makes sense intuitively, whether it seems to be a reasonable approach.