Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.

Slides:



Advertisements
Similar presentations
Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Advertisements

Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
VALIDITY AND RELIABILITY
Tickle: IQ and Personality Tests - Tickle.com: The Classic IQ Test
Part II Sigma Freud & Descriptive Statistics
What is a Good Test Validity: Does test measure what it is supposed to measure? Reliability: Are the results consistent? Objectivity: Can two or more.
Part II Sigma Freud & Descriptive Statistics
Standardized Tests What They Measure How They Measure.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Chapter Fifteen Understanding and Using Standardized Tests.
Issues of Technical Adequacy in Measuring Student Growth for Educator Effectiveness Stanley Rabinowitz, Ph.D. Director, Assessment & Standards Development.
Issues Related to Assessment with Diverse Populations
Data and the Nature of Measurement
1 School Counseling PowerPoint produced by Melinda Haley, M.S., New Mexico State University. “This multimedia product and its contents are protected under.
MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.
Beginning the Research Design
Chapter 5 Instrument Selection, Administration, Scoring, and Communicating Results.
SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Standardized Test Scores Common Representations for Parents and Students.
Author: Sabrina Hinton. Year and Publisher: American Guidance Service.
Woodcock-Johnson Cognitive Ability Test Brenda Stewart Ed 6331 Spring 2004.
Measurement Concepts & Interpretation. Scores on tests can be interpreted: By comparing a client to a peer in the norm group to determine how different.
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Measurement and Data Quality
Chapter 14 Understanding and Using Standardized Tests Viewing recommendations for Windows: Use the Arial TrueType font and set your screen area to at least.
Reading Assessments for Elementary Schools Tracey E. Hall Center for Applied Special Technology Marley W. Watkins Pennsylvania State University Frank.
Collecting Quantitative Data
Standardization the properties of objective tests.
Measurement in Exercise and Sport Psychology Research EPHE 348.
Collecting Quantitative Data Creswell Chapter 6. Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class =
Instrumentation.
Foundations of Educational Measurement
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Data Analysis. Quantitative data: Reliability & Validity Reliability: the degree of consistency with which it measures the attribute it is supposed to.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Copyright © 2008 by Nelson, a division of Thomson Canada Limited Chapter 11 Part 3 Measurement Concepts MEASUREMENT.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Collecting Quantitative Data
Principles of Test Construction
Chapter 3 Understanding Test Scores Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition.
Scores & Norms Derived Scores, scales, variability, correlation, & percentiles.
CCSSO Criteria for High-Quality Assessments Technical Issues and Practical Application of Assessment Quality Criteria.
Chapter 4: Test administration. z scores Standard score expressed in terms of standard deviation units which indicates distance raw score is from mean.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
Staffing Chapters
Selecting a Sample. Sampling Select participants for study Select participants for study Must represent a larger group Must represent a larger group Picked.
Basic Assessment Principles Chapter 2.  Nominal  Ordinal  Interval  Ratio Measurement Scales.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
Chapter 6 - Standardized Measurement and Assessment
Module 5: Basic Concepts of Measurement. Module 5 focuses on concepts and terminology that will be helpful as you administer and interpret tests and other.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Educational Research Chapter 5 Selecting Measuring Instruments Gay and Airasian.
Chapter 2 Norms and Reliability. The essential objective of test standardization is to determine the distribution of raw scores in the norm group so that.
Interpreting Test Results using the Normal Distribution Dr. Amanda Hilsmier.
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Copyright © 2009 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 47 Critiquing Assessments.
Principles of Language Assessment
CHAPTER 4 Research in Psychology: Methods & Design
CHAPTER 3: Practical Measurement Concepts
Reliability & Validity
Understanding and Using Standardized Tests
CHAPTER 5: Selecting and Using Assessment Instruments
Presentation transcript:

Chapter 3 Selection of Assessment Tools

Council of Exceptional Children’s Professional Standards All special educators should possess a common core of knowledge and skills related to assessment: Basic terminology used in assessment Legal provisions and ethical principles regarding assessment of individuals Screening, prereferral, referral and classification procedures Use and limitations of assessment instruments National, state, or provincial, and local accommodations and modifications

Legal Guidelines for Assessment Assessment is: Nondiscriminatory Focuses on educational needs Comprehensive and multidisciplinary Assessment tools are technically adequate and are administered by trained professionals Rights of parents and students are protected

Professional Guidelines Standards for Educational and Psychological Testing (1985) Test publishers’ catalogs and manuals Mental Measurements Yearbooks series Tests in Print IV ERIC Clearinghouse on Assessment and Evaluation (

Evaluation Criteria The tool must fit the purpose of the assessment The assessment instrument must be appropriate for the student The assessment instrument should match the skills of the professional using it The assessment tool must be technically adequate The assessment instrument should be efficient

Measurement Terminology Measurement scales may be: Nominal Ordinal Interval Ratio Descriptive statistics include measures of: Central tendency Measures of variability Correlation

Evaluating Technical Quality of Assessment Tools Age, grade, and gender of norm group members should match characteristics of the students assessed Random selection is preferable Norm group should be representative of the population and should be of adequate size Test norms should be recent to reflect current standards

Reliability Test-retest reliability refers to consistency or measure from one administration to the next Split-half reliability is concerned with internal consistency Interrater or interobserver reliability is concerned with consistency among evaluators

Validity Content validity is the extent to which the instrument represents the content of interest Criterion-related validity relies on an outside criterion and may examine predictive validity or concurrent validity Construct validity examines the instrument and the theoretical construct it intends to measure

Measurement Error Related to variability and reliability of an assessment device Standard error of measurement can be quantified

Test Scores Informal Measures Frequency counts and percentages are interval data Criterion-referenced tests yield nominal data Rating scales provide ordinal data

Norm-Referenced Test Scores Age and grade equivalent are ordinal scores Percentile rank scores Standard scores use a set mean and standard deviation Stanines represent a range of performance

Normal Distribution

Relationship Between Types of Scores

Promoting Nonbiased Assessment For students whose primary language is not English, tests and test directions should be translated into the home language Interpreters may be used in the assessment of students who speak languages other than English Culture-free and culture-fair measures attempt to minimize bias

Promoting Nonbiased Assessment, continued Culture-specific measures relate directly to specific cultures Separate norms may be provided for students from diverse groups Pluralistic measures assess a broad range of skills Test administration procedures may be modified

Promoting Nonbiased Assessment, continued Dynamic assessment can be used to study the student’s learning ability Standardized tests can be replaced with informal procedures Standardized testing could be abolished

Selection of Nondiscriminatory Assessment Tools Norm groups should be representative of the race, culture, and gender of the student to be assessed Tests containing items that reflect cultural bias should be avoided The tools for assessment should minimize the effects of the disability