Conny’s Office Hours will now be by APPOINTMENT ONLY. Please her at if you would like to meet with.

Slides:



Advertisements
Similar presentations
Topics: Quality of Measurements
Advertisements

Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Reliability and Validity checks S-005. Checking on reliability of the data we collect  Compare over time (test-retest)  Item analysis  Internal consistency.
Types of Reliability.
Reliability Definition: The stability or consistency of a test. Assumption: True score = obtained score +/- error Domain Sampling Model Item Domain Test.
MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
Chapter 5 Reliability Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
VALIDITY AND RELIABILITY
1Reliability Introduction to Communication Research School of Communication Studies James Madison University Dr. Michael Smilowitz.
Defining, Measuring and Manipulating Variables. Operational Definition  The activities of the researcher in measuring and manipulating a variable. 
 A description of the ways a research will observe and measure a variable, so called because it specifies the operations that will be taken into account.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
Reliability & Validity.  Limits all inferences that can be drawn from later tests  If reliable and valid scale, can have confidence in findings  If.
Part II Sigma Freud & Descriptive Statistics
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
Methods for Estimating Reliability
CORRELATIONAL ANALYSES EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Reliability and Validity of Research Instruments
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.
Reliability n Consistent n Dependable n Replicable n Stable.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
RELIABILITY & VALIDITY
Reliability and Validity in Experimental Research ♣
Reliability n Consistent n Dependable n Replicable n Stable.
Reliability and Validity
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
SOWK 6003 Social Work Research Week 4 Research process, variables, hypothesis, and research designs By Dr. Paul Wong.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
Psych 231: Research Methods in Psychology
Variables cont. Psych 231: Research Methods in Psychology.
Validity, Reliability, & Sampling
Research Methods in MIS
Experimental Research
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
I/O Psychology Research Methods. What is Science? Science: Approach that involves the understanding, prediction, and control of some phenomenon of interest.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Reliability & Validity
Reliability & Agreement DeShon Internal Consistency Reliability Parallel forms reliability Parallel forms reliability Split-Half reliability Split-Half.
Independent vs Dependent Variables PRESUMED CAUSE REFERRED TO AS INDEPENDENT VARIABLE (SMOKING). PRESUMED EFFECT IS DEPENDENT VARIABLE (LUNG CANCER). SEEK.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 12 Making Sense of Advanced Statistical.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Designs and Reliability Assessing Student Learning Section 4.2.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Reliability n Consistent n Dependable n Replicable n Stable.
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)
Reliability: Introduction. Reliability Session Definitions & Basic Concepts of Reliability Theoretical Approaches Empirical Assessments of Reliability.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.
Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.
Language Assessment Lecture 7 Validity & Reliability Instructor: Dr. Tung-hsien He
Laboratory Experiment ValidityReliability Test-Retest Artificial Mundane Realism Generalise Consistent Informed Consent Demand Characteristics Control.
Measurement and Scaling Concepts
Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.
VALIDITY What is validity? What are the types of validity? How do you assess validity? How do you improve validity?
MGMT 588 Research Methods for Business Studies
Ch. 5 Measurement Concepts.
Product Reliability Measuring
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
assessing scale reliability
The first test of validity
Presentation transcript:

Conny’s Office Hours will now be by APPOINTMENT ONLY. Please her at if you would like to meet with her

Measurement Concepts

Review from Wed… 3 Main Types of Validity: Construct Validity – are you measuring what you think you’re measuring Internal Validity – how certain are you that the IV effected the DV External Validity – can your results be replicated by others in another setting

Review of Validity Lab experiments (using the experimental method) are typically high in internal validity because…? Lab experiments are usually high in ____ validity but low in _____ validity.

RELIABILITY OF MEASURES Reliability = consistency or stability of a measure True Score Measurement Error Pearson Product-Moment Correlation Coefficient

Less error

RELIABILITY OF MEASURES Reliability of your measure is important You only get one shot Leads to stability and replication

Pearson r Variables covary in opposite directions Variables covary in the same direction r =.675

RELIABILITY OF MEASURES Test-Retest Reliability Assessed by measuring the same individuals two points in time Vulnerable to artificiality Vulnerable to maturation

RELIABILITY OF MEASURES Internal Consistency Reliability = because all items measure the same thing, they should be similar and consistent Split-half reliability Cronbach’s alpha Item-total correlations Interrater Reliability Correlation between the observations of raters

RELIABILITY OF MEASURES Reliability and Accuracy of Measures Reliability indexes do not indicate whether a particular measure is an accurate measure of the variable of interest A measure can be highly reliable but not accurate