Understanding and Using Standardized Tests

Slides:



Advertisements
Similar presentations
Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Advertisements

Assessment in Early Childhood Education Fifth Edition Sue C. Wortham
Standardized Tests: What Are They? Why Use Them?
TABE II: Using TABE ® Results to Inform Instruction Virginia Adult Learning Resource Center George Bailey & Hillary Major.
Evaluation of the Iowa Algebra Aptitude Test Terri Martin Doug Glasshoff Mini-project 1 June 17, 2002.
Interpreting Results from the Iowa Test of Basic Skills and the Cognitive Abilities Test (ITBS/CogAT) A Parent Guide.
Standardized Tests What They Measure How They Measure.
Gary D. Borich Effective Teaching Methods 6th Edition
Chapter Fifteen Understanding and Using Standardized Tests.
By: Michele Leslie B. David MAE-IM WIDE USAGE To identify students who may be eligible to receive special services To monitor student performance from.
Chapter 4 Validity.
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
About the tests PATMaths Fourth Edition:
Standardized Test Scores Common Representations for Parents and Students.
Classroom Assessment A Practical Guide for Educators by Craig A
Computer Integrated assessment. Computer integrated assessment Measurement, testing, assessment and evaluation What is the difference?
Chapter 14 Understanding and Using Standardized Tests Viewing recommendations for Windows: Use the Arial TrueType font and set your screen area to at least.
FOR DELAWARE’S STUDENTS A NEW STANDARD. The test has changed Delaware students are now taking DCAS – the Delaware Comprehensive Assessment System. This.
Topic 4: Formal assessment
Becoming a Teacher Ninth Edition
Classroom Assessment and Grading
High Stakes Testing EDU 330: Educational Psychology Daniel Moos.
Understanding and Using Standardized Tests
Classroom Assessments Checklists, Rating Scales, and Rubrics
Evaluation of Nelson-Denny Reading Test Mini Project I By Becky Brandl.
Diagnostics Mathematics Assessments: Main Ideas  Now typically assess the knowledge and skill on the subsets of the 10 standards specified by the National.
Understanding the TerraNova Test Testing Dates: May Kindergarten to Grade 2.
ED /Supporting English Language Learners in Literacy and Content Knowledge Development (SELL) December 9, 2010.
Educational Psychology: Theory and Practice Chapter 14 Standardized Tests This multimedia product and its contents are protected under copyright law. The.
MELS 601 Ch. 7. If curriculum can be defined most simply as what is taught in the school, then instruction is the how —the methods and techniques that.
Session 7 Standardized Assessment. Standardized Tests Assess students’ under uniform conditions: a) Structured directions for administration b) Procedures.
Chapter 15 Understanding Standardized Assessment.
Assessment Information from multiple sources that describes a student’s level of achievement Used to make educational decisions about students Gives feedback.
McGraw-Hill/Irwin © 2012 The McGraw-Hill Companies, Inc. All rights reserved. Obtaining Valid and Reliable Classroom Evidence Chapter 4:
Standardized Testing. Basic Terminology Evaluation: a judgment Measurement: a number Assessment: procedure to gather information.
Chapter 6 - Standardized Measurement and Assessment
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
Foundations of American Education: Perspectives on Education in a Changing World, 15e © 2011 Pearson Education, Inc. All rights reserved. Chapter 11 Standards,
Standardized Testing EDUC 307. Standardized test a test in which all the questions, format, instructions, scoring, and reporting of scores are the same.
Terra Nova By Tammy Stegman, Robyn Ourada, Sandy Perry, & Kim Cotton.
Chapter 1 Assessment in Elementary and Secondary Classrooms
by Holcomb Hathaway Publishers
Assessment.
EVALUATING EPP-CREATED ASSESSMENTS
Standardized Test Reporting
Classroom Assessments Checklists, Rating Scales, and Rubrics
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
American Institutes for Research
Assessment of Learning 1
CHAPTER 3: Practical Measurement Concepts
Standardized Test Overview
Defining Co-Teaching and Inclusion
Title III of the No Child Left Behind Act
Data Usage Response to Intervention
Classroom Assessments Checklists, Rating Scales, and Rubrics
Reliability & Validity
the BIG 3 OVERVIEW OF CRITERIA FOR EVALUATING EDUCATIONAL ASSESSMENT
Bursting the assessment mythology: A discussion of key concepts
Prepared by: Toni Joy Thurs Atayoc, RMT
SCORING TERMINOLOGY USED IN ASSESSMENT
Principles of Assessment & Criteria of good assessment
Start with the Science & Technology Standards (2002, 2008?)
Understanding ITBS Scores
Ace it! Summer Conference 2011 Assessment
TABE II: Using TABE® Results to Inform Instruction
TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1
College and Career Readiness
Why do we assess?.
EDUC 2130 Quiz #10 W. Huitt.
Chapter 3: How Standardized Test….
Presentation transcript:

Understanding and Using Standardized Tests Chapter Fifteen Understanding and Using Standardized Tests

Standardized testing and technology Overview Standardized tests Using standardized tests for accountability purposes: High-stakes testing Standardized testing and technology Copyright © Houghton Mifflin Company. All rights reserved. 1

Characteristics of Standardized Tests Designed by people with specialized knowledge and training in test construction. Every person who takes the test responds to the same items under the same conditions. The answers are evaluated according to the same scoring standards. The scores are interpreted through comparison to the scores obtained from a group that took the same test under the same conditions or through comparison to a predetermined standard. Copyright © Houghton Mifflin Company. All rights reserved.

Criteria for Evaluating Standardized Tests Reliability Stability in test performance Validity Test accuracy Content validity, predictive validity, construct validity Normed excellence Norm group representation compared to the general population Examinee appropriateness Appropriateness for a particular group of students Copyright © Houghton Mifflin Company. All rights reserved. 2

Reliability Test-retest reliability Alternate-form reliability Administer the same test to the same people on two occasions and measure the extent to which the rankings change over time Alternate-form reliability Administer two equivalent forms of a test to the same group of students at the same time and compare the results Split-half reliability Administer a single test to a group of students, create two scores by dividing the test in half, and measure the extent to which the rankings change from one half to the other Copyright © Houghton Mifflin Company. All rights reserved.

Content validity evidence How well a test’s items reflect a particular body of knowledge and skill Predictive validity evidence How well a test predicts a student’s future behavior Construct validity evidence How well a test measures some internal attribute of a person Copyright © Houghton Mifflin Company. All rights reserved.

Types of Standardized Tests Achievement Tests Reveal how much of a subject or skill has been learned Aptitude Tests Reveal how much knowledge and skill a student could acquire with effective instruction Copyright © Houghton Mifflin Company. All rights reserved.

Types of Achievement Tests Assesses one’s competence in selected basic skill areas; often taken to graduate. Competency test Single-subject test designed to identify specific strengths and weaknesses. Diagnostic test Assesses how much one has learned in multiple school subjects. Achievement battery Assesses how much one has learned in a particular school subject. Single-subject achievement test Description Type of Test Copyright © Houghton Mifflin Company. All rights reserved.

Norm-Referenced Tests and Criterion-Referenced Tests Test where one’s performance is evaluated with reference to a norming group. Criterion-referenced test Test where one’s performance is evaluated with reference to some standard or criterion. Copyright © Houghton Mifflin Company. All rights reserved.

Interpreting Standardized Test Scores Grade equivalent scores Interprets test performance in terms of grade level Percentile ranks Score that indicates the percentage of students who are at or below a given student’s score Standard scores Score that is expressed in terms of standard deviations Stanine score Type of standard score that divides a population into nine groups. Copyright © Houghton Mifflin Company. All rights reserved. 7

The Normal Probability Curve Copyright © Houghton Mifflin Company. All rights reserved. 8

Relationship Among z Scores, T Scores, and Percentile Ranks Psychology Applied to Teaching. Snowman/Biehler. Copyright © Houghton Mifflin Company. All rights reserved. Copyright © Houghton Mifflin Company. All rights reserved. 9

Percentage of Cases in Each Stanine Copyright © Houghton Mifflin Company. All rights reserved. 10

What is High-Stakes Testing? High stakes testing is… Using standardized test scores, either by themselves or in conjunction with other data, to determine whether students get promoted to the next grade or graduate from high school, whether teachers and administrators receive financial rewards or demotions, and whether school districts receive additional state funds or lose their accreditation. Copyright © Houghton Mifflin Company. All rights reserved.

No Child Left Behind (NCLB) Testing Annual testing of students in grades 3-12 Adequate yearly progress (AYP) States must demonstrate each year that an additional percentage of all students have reached the proficient level Reporting States and school districts must issue report cards to parents and the general public that describe how every group of students has performed on the annual assessment Copyright © Houghton Mifflin Company. All rights reserved.

Arguments in Support of High-Stakes Testing Programs Goal clarity Improved quality control Beneficial effects for teaching Beneficial effects for students Copyright © Houghton Mifflin Company. All rights reserved.

Arguments Critical of High-Stakes Testing Programs Structural limitations Misinterpretation and misuse of test results A one-size-fits-all approach to motivation Undesirable side effects Copyright © Houghton Mifflin Company. All rights reserved.

Research on the Effects of High-Stakes Testing Programs Effect on achievement Effect on motivation Effect on teachers Effect on instruction Effect on the drop-out rate Copyright © Houghton Mifflin Company. All rights reserved.

Recommendations for State Testing Systems Each state should adopt only those content standards that represent the most important knowledge and skills that students need to learn A state’s content standards should clearly describe exactly what is being assessed so teachers can create lessons that directly address those standards Scores on a state assessment should be reported on a standard-by-standard basis for each student, school, and district States should provide school districts with additional assessment procedures to assess those standards that the required assessment does not cover States should monitor the curricula of school districts to ensure that instruction addresses all content standards and subjects, not just those assessed by the required state test Copyright © Houghton Mifflin Company. All rights reserved.

Recommendations for State Testing Systems State assessments should be designed so that all students have an equal opportunity to demonstrate which of the state’s standards they have mastered All tests should satisfy the Standards for Educational and Psychological Testing of the American Educational Research Association and similar test quality guidelines Teachers and principals should receive professional development training that helps them use test results to optimize children’s learning States should continually seek to improve the quality of their assessments Copyright © Houghton Mifflin Company. All rights reserved.

Standardized Testing and Technology Using technology to prepare students for assessments Using technology to assess mastery of standards e.g., American College Testing (ACT); Project Essay Grade (PEG) Computer adaptive testing (CAT) Computers determine sequence and difficulty level of test items Copyright © Houghton Mifflin Company. All rights reserved. 13