Reliability.

Slides:



Advertisements
Similar presentations
Agenda Levels of measurement Measurement reliability Measurement validity Some examples Need for Cognition Horn-honking.
Advertisements

Chapter 16: Correlation.
Reliability IOP 301-T Mr. Rajesh Gunesh Reliability  Reliability means repeatability or consistency  A measure is considered reliable if it would give.
Correlation, Reliability and Regression Chapter 7.
Cronbach’s Alpha & Maximized 4. SAS proc corr nosimple nocorr nomiss alpha; var q1-q10; run; Cronbach Coefficient Alpha VariablesAlpha Raw
Topics: Quality of Measurements
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
Part II Sigma Freud & Descriptive Statistics
Measurement the process by which we test hypotheses and theories. assesses traits and abilities by means other than testing obtains information by comparing.
Methods for Estimating Reliability
Measurement. Scales of Measurement Stanley S. Stevens’ Five Criteria for Four Scales Nominal Scales –1. numbers are assigned to objects according to rules.
Reliability n Consistent n Dependable n Replicable n Stable.
Nominal Level Measurement n numbers used as ways to identify or name categories n numbers do not indicate degrees of a variable but simple groupings of.
A quick introduction to the analysis of questionnaire data John Richardson.
Conny’s Office Hours will now be by APPOINTMENT ONLY. Please her at if you would like to meet with.
Correlation Coefficient Correlation coefficient refers to the type of relationship between variables that allows one to make predications from one variable.
MGTO 324 Workshop 4: Reliability. Activity 1 Use the data management concepts discussed in the last lesson to input all the data provided on the given.
Equations in Simple Regression Analysis. The Variance.
Scientific Method/Statistics. Scientific Method 1. Observe 2. Hypothesize/Predict 3. Experiment Try again! 4. Analyze 5. Conclude 6. Report.
Data Analysis. Quantitative data: Reliability & Validity Reliability: the degree of consistency with which it measures the attribute it is supposed to.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
Irkutsk State Medical University Department of Faculty Therapy Correlations Khamaeva A. A. Irkutsk, 2009.
Reliability: Introduction. Reliability Session 1.Definitions & Basic Concepts of Reliability 2.Theoretical Approaches 3.Empirical Assessments of Reliability.
Rater Reliability How Good is Your Coding?. Why Estimate Reliability? Quality of your data Number of coders or raters needed Reviewers/Grant Applications.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Research Methodology Lecture No :24. Recap Lecture In the last lecture we discussed about: Frequencies Bar charts and pie charts Histogram Stem and leaf.
1 Chapter 4 – Reliability 1. Observed Scores and True Scores 2. Error 3. How We Deal with Sources of Error: A. Domain sampling – test items B. Time sampling.
Tests and Measurements Intersession 2006.
Correlation & Regression Chapter 15. Correlation It is a statistical technique that is used to measure and describe a relationship between two variables.
Chapter 13 Descriptive Data Analysis. Statistics  Science is empirical in that knowledge is acquired by observation  Data collection requires that we.
A Significance Test for r An estimator r    = 0 ? t-test.
Testing Your Hypothesis In your previous assignments you were supposed to develop two hypotheses that examine a relationship between two variables. For.
Chapter 9 Correlational Research Designs. Correlation Acceptable terminology for the pattern of data in a correlation: *Correlation between variables.
Reliability n Consistent n Dependable n Replicable n Stable.
Reliability: Introduction. Reliability Session 1.Definitions & Basic Concepts of Reliability 2.Theoretical Approaches 3.Empirical Assessments of Reliability.
Analysis of Variance ANOVA. Example Suppose that we have five educational levels in our population denoted by 1, 2, 3, 4, 5 We measure the hours per week.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Reliability When a Measurement Procedure yields consistent scores when the phenomenon being measured is not changing. Degree to which scores are free of.
Chapter 6 Norm-Referenced Reliability and Validity.
Chapter 6 Norm-Referenced Measurement. Topics for Discussion Reliability Consistency Repeatability Validity Truthfulness Objectivity Inter-rater reliability.
Measurement and Scaling Concepts
T-test calculations.
Reliability Analysis.
Spearman’s Rho Correlation
Correlation analysis is undertaken to define the strength an direction of a linear relationship between two variables Two measurements are use to assess.
Ch. 5 Measurement Concepts.
Chapter 7 Cooper and Schindler
Product Reliability Measuring
Statistics in SPSS Lecture 10
Chapter 10 CORRELATION.
Correlational Studies
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
assessing scale reliability
Classical Test Theory Margaret Wu.
Computing Reliability
Introduction to Measurement
Calculating Reliability of Quantitative Measures
Questionnaire Reliability
Reliability, validity, and scaling
Instrumentation: Reliability Measuring Caring in Nursing
Chapter 5 Conceptualization, Operationalization, and Measurement
Measurement: Part 1.
Reliability Analysis.
The first test of validity
Measurement Concepts and scale evaluation
Ch 5: Measurement Concepts
Procedures for Estimating Reliability
UCLA Department of Medicine
Presentation transcript:

Reliability

How to test Repeat the same test with the same group Use the same test with different group In general Observe = True + Error Reliability = Var(True) / Var(Error) Data Quantitative – Scale and Ratio Ordinal Scale

Quantitative (Pearson correlation)

Ordinal Scale (Spearman Rank Correlation)

Split – Half Method (Spearman Brown)

Cronbachs’ Alpha Coefficient This value is minimum of reliability of True Component. The Cronbaschs’s alpha will increase when question increases.

Kuder – Richardson (For Dichotomous) K-R20 K-R21

From SPSS (Example_Reliability)

Assignment Test the reliability of important variables (Key variable) using the different style of correlation. Collect more data and check reliability again.