Chapter 10: Measurement Slavin Reliability & Validity Types of Measures Behavioral Observation Systems Sample Size Determination.

Slides:



Advertisements
Similar presentations
Chapter 8 Flashcards.
Advertisements

Developing a Questionnaire
Chapter 13 and 14. Error  Type 1: False positive. The effect was not really present, but our statistics lead us to believe that it is.  Type 2: False.
The Research Consumer Evaluates Measurement Reliability and Validity
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
VALIDITY AND RELIABILITY
Part II Sigma Freud & Descriptive Statistics
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
University of St. Thomas EDUC 5355 Chapter 2—Assessment The Main Points Dr. Ann Weiss Adjunct Professor University of St. Thomas EDUC 5355.
CORRELATIONAL ANALYSES EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Chapter 5: Improving and Assessing the Quality of Behavioral Measurement Cooper, Heron, and Heward Applied Behavior Analysis, Second Edition.
Collecting Quantitative Data
Chapter 6 Developing Eva. Procedures Key Concepts Purposes of Evaluation Evaluation Procedure Design General Techniques of Eva. Procedures.
Measurement Validity and Reliability. Reliability: The degree to which measures are free from random error and therefore yield consistent results.
Concept of Reliability and Validity. Learning Objectives  Discuss the fundamentals of measurement  Understand the relationship between Reliability and.
Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.
Chapter 10 Collecting Quantitative Data. SURVEY QUESTIONNAIRES Establishing Procedures to Collect Survey Data Recording Survey Data Establishing the Reliability.
Assessing Learners With Special Needs
MA 102 Statistical Controversies Wednesday, February 13, 2002 Today: Discuss of data ethics, and exercises Measuring: Turning ideas to numbers Exercise.
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
Chapter 8 Conducting & Reading Research Baumgartner et al Chapter 9 Descriptive Research.
Chapter 3 Assessment for Identification © Taylor & Francis 2015.
Validity and Reliability Dr. Voranuch Wangsuphachart Dept. of Social & Environmental Medicine Faculty of Tropical Medicine Mahodil University 420/6 Rajvithi.
Educational Psychology: Theory and Practice Chapter 13 Assessing Student Learning.
RELIABILITY AND VALIDITY OF DATA COLLECTION. RELIABILITY OF MEASUREMENT Measurement is reliable when it yields the same values across repeated measures.
Instrumentation.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Validity and Reliability Edgar Degas: Portraits in a New Orleans Cotton Office, 1873.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
1. Researchers use the terms variable, subject, sample, and population when describing their research. 2. Psychologists do research to measure and describe.
Research Process Parts of the research study Parts of the research study Aim: purpose of the study Aim: purpose of the study Target population: group whose.
Independent vs Dependent Variables PRESUMED CAUSE REFERRED TO AS INDEPENDENT VARIABLE (SMOKING). PRESUMED EFFECT IS DEPENDENT VARIABLE (LUNG CANCER). SEEK.
Wade/Tavris, (c) 2006, Prentice Hall How Psychologists Do Research Chapter 2.
Chapter 7 Instrumentation. Empirical Data We need DATA We can’t rely solely upon our senses We develop INSTRUMENTS to compensate for the limitations of.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Measurement Validity.
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College For Class # 3 Copyright © 2005 by R. Halstead. All rights reserved.
Inferential Statistics Body of statistical computations relevant to making inferences from findings based on sample observations to some larger population.
Reliability, Validity, and Bias. Reliability Reliability Reliability is the extent to which an experiment, test, or any measuring procedure yields the.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Transition Assessment Review of Concepts in Flexer, Simmons, Luft, & Baer Review of Concepts in Flexer, Simmons, Luft, & Baer.
Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.
Measurement MANA 4328 Dr. Jeanne Michalski
The Scientific Method How to Solve just about anything Chemistry.
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Chapter 11 Intelligence. Mental quality consisting of the ability to learn from experience, solve problems, and use knowledge to adapt to new situations.
Reliability Ability to produce similar results when repeated measurements are made under identical conditions. Consistency of the results Can you get.
REVIEW I Reliability scraps Index of Reliability Theoretical correlation between observed & true scores Standard Error of Measurement Reliability measure.
Lecture 5 Introduction to Sampling Distributions.
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
DESCRIPTIVE STUDIES Let’s get the facts, fool!. Descriptive Methods Methods that yield descriptions or behavior but not necessarily causal explanations.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
MULTIVARIATE ANALYSIS. Multivariate analysis  It refers to all statistical techniques that simultaneously analyze multiple measurements on objects under.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
More about tests and intervals CHAPTER 21. Do not state your claim as the null hypothesis, instead make what you’re trying to prove the alternative. The.
Dr. Jeffrey Oescher 27 January 2014 Technical Issues  Two technical issues  Validity  Reliability.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Assessment in Education ~ What teachers need to know.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Ch. 5 Measurement Concepts.
RELIABILITY OF QUANTITATIVE & QUALITATIVE RESEARCH TOOLS
Chapter 8: Hypothesis Testing and Inferential Statistics
Modern Tests of Mental Abilities
پرسشنامه کارگاه.
Measurement Reliability and Validity
Scoring: Measures of Central Tendency
Design Considerations: Independent Samples v. Repeated Measures
Reliability, Validity, and Bias
Work Schedule Methodological Issues Variables Constant
Presentation transcript:

Chapter 10: Measurement Slavin Reliability & Validity Types of Measures Behavioral Observation Systems Sample Size Determination

What is Reliability? Reliability- the degree to which a measure is consistent in producing the same reading or results _features/ext/workshops/reliability2.html _features/ext/workshops/reliability2.html

What is Validity? Validity- the degree to which something measures the concept it is supposed to measure Common error in educational research is to use standardized achievement tests as an assessment of school learning without examining it carefully to see that it corresponds to what is taught in school

Types of Measures: Achievement & Aptitude Tests Aptitude Tests Achievement Tests Standardized Tests Norm-referenced Tests Criterion-referenced tests Authentic Tests Questionnaire Scales

Types of Measures: Behavioral Observation Guidelines Define – High-inference behaviors – Low-inference behaviors Schedule Observe Frequency Reliability and bias

Sample Size: How many is enough? Sample Size-depends on how variable the data are and how large we expect the effect to be Statistical Power- the ability of a research design to detect true differences and avoid false negative errors