Review of Cut Scores and Conversion Tables (Angoff Method)

Slides:



Advertisements
Similar presentations
Creating and Using Rubrics for Evaluating Student Work Prepared by: Helen Jordan Mathematics Coordinator Normandie Avenue Elementary.
Advertisements

Woodcock Reading Mastery Test-Revised
EXAMPLE 1 Standardized Test Practice SOLUTION Substitute several values of h into the equation C = h and solve for C.Then identify the table that.
MLA POD TRAINING #3 JANUARY VIDEO DISCUSSION PROTOCOL 1) Select a discussion partner 2) Choose 2 of the Key Elements from your video notes and share.
Wide Range Achievement Test WRAT4 Authors: Gary S. Wilkinson, PhD Gary J. Robertson, PhD.
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
Setting Performance Standards Grades 5-7 NJ ASK NJDOE Riverside Publishing May 17, 2006.
Wastewater Treatment Plant Operator Exam Setting Performance Standards With The Modified Angoff Procedure.
D ATA, D ATA, AND MORE D ATA Paraeducator Recertification Presented by: Lisa Andreasen April 17, 2013.
Vertical Scale Scores.
Data Interpretation ACCESS for ELLs® The Rhode Island Department of Education Presented by Bob Measel ELL Specialist Office of Instruction, Assessment,
MATHEMATICS LEADERSHIP ALLIANCE FORMATIVE ASSESSMENT POD TRAINING #2.
Office of Institutional Research, Planning and Assessment January 24, 2011 UNDERSTANDING THE DIAGNOSTIC GUIDE.
Virginia Title III Statewide Consortium Conference Blacksburg, Virginia January 21-22, 2015 Virginia Department of Education: ACCESS for ELLs ® Teacher.
Compass: Module 2 Compass Requirements: Teachers’ Overall Evaluation Rating Student Growth Student Learning Targets (SLTs) Value-added Score (VAM) where.
Adjectives / 1. Interpret orally information presented in tables, charts, graphs, etc. / Interpreting information presented in a pie graph.
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
Information for school leaders and teachers regarding the process of creating Student Learning Targets. Student Learning targets.
Standards-based assessment and reporting An Overview for Parents.
Diocesan 5-Year Plan Year 1 (14/15): Educating Educators Year 2 (15/16): Creating a Diocesan Grading & Assessment Philosophy Year 3 (16/17): Aligning Related.
Data Vocabulary Language Arts Summer Cadre 2006 Migdalia Rosario Varsity Lakes Middle Jennifer Miller Varsity Lakes Middle Pat Zubal Dunbar Middle School.
Standards-Based Assessment Design MCLA PRACTICAL PROFICIENCY OCTOBER 27, 2014 HEIDI MCGINLEY, EXECUTIVE DIRECTOR,
Using Data in the Goal-Setting Process Webinar September 30, 2015.
Welcome The challenges of the new National Curriculum & Life without Levels.
AP Studio Art Portfolios in Transition to Next Generation Assessment: A Continuum of Performance Assessment Approaches CCSSO Conference June 20, 2013 Rosemary.
ELA & Math Scale Scores Steven Katz, Director of State Assessment Dr. Zach Warner, State Psychometrician.
A How-To Guide on Reading Grade Equivalent Scores By Abby Helterbrand and Kate Evans.
USING SKILLS IOWA DATA TO GUIDE INSTRUCTION STEPHANIE N. MOHORNE MAY 15, 2015.
Annual Measurable Objectives (trajectory targets).
FBISD Grading Policy Changes EIA(Local) Student/Parent Handbook Page 11.
Welcome to MMS MAP DATA INFO NIGHT 2015.
WHAT IS A RUBRIC?.  A CRITERION BASED SCORING GUIDE.  The criteria are qualities that must be met for student work to measure up to a standard.
ASSESSMENT TOOLS DEVELOPMENT: RUBRICS Marcia Torgrude
Fidelity of Implementation A tool designed to provide descriptions of facets of a coherent whole school literacy initiative. A tool designed to provide.
Product Support - Darek Sady Gradebook: BlackBoard 6.
Claim 1 Smarter Balanced Sample Items Grade 3 - Target E Use place value understanding and properties of operations to perform multi-digit arithmetic.
UNDERSTANDING YOUR PSAT SCORES Warrior Wednesday.
Standards-Based Report Cards Glynn County Schools 1 st -3 rd Grades
Standards-Based Report Cards
END OF KEY STAGE TESTS SUMMER TERM 2016.
Understanding AzMERIT Results and Score Reporting An Overview.
What does Proficiency-based Education mean to Maranacook? Community Forum December 3, 2015.
The Normal Distribution and Norm-Referenced Testing Norm-referenced tests compare students with their age or grade peers. Scores on these tests are compared.
Unraveling the Mysteries of Setting Standards and Scaled Scores Julie Miles PhD,
TEST SCORES INTERPRETATION - is a process of assigning meaning and usefulness to the scores obtained from classroom test. - This is necessary because.
Assessment Assessment is the collection, recording and analysis of data about students as they work over a period of time. This should include, teacher,
ELA teachers PD may 12, 2010 Jorge Garcia (this slide added for topic data– not part of presentation)
Academically/Intellectually Gifted Referral, Screening, and Placement Processes Beginning in Third Grade.
Presentation to the Nevada Council to Establish Academic Standards Proposed Math I and Math II End of Course Cut Scores December 22, 2015 Carson City,
Understanding How Evaluations are Calculated Professional Practices, Measures of Student Learning/ Outcomes- Calculating Scores & Translating SLOs/SOOs.
Creating Student Success through the Data Team Process Mason City Community School District Kathryn Schladweiler TJ.
AP Lang by the Numbers. Scoring Systems -When we talk about scores, there are two separate scoring systems that matter to you. What is my grade in class?
How the CAP Science and Social Studies Tests Measure Student Growth.
1 Testing Various Models in Support of Improving API Scores.
It Begins With How The CAP Tests Were Designed
Update on Data Collection and Reporting
Reliability Module 6 Activity 5.
Standard Deviation.
Understanding How Evaluations are Calculated
EQ: What effect do transformations have on summary statistics?
Online Practice Tests to do
Data Tables Packet #19.
Using the 4.0 Gradebook.
Spreadsheet Basics: Absolute and Relative Cells
GOOD EVENING Y6 INFORMATION EVENING.
Third Grade FSA Parent Meeting
Standards Based Grading
Academically/Intellectually Gifted
Psychological Testing
Virginia Board of Education’s
Presentation transcript:

Review of Cut Scores and Conversion Tables (Angoff Method)

Scoring Guides Reliable Scoring Scoring guides should clearly indicate the level and point value of each item on the assessment. Scoring guides should provide clear guidance on how to assign points to a student response on an assessment item. Scoring guides allow different teachers to assign the same score for the same level of performance on an assessment – Reliability

The Angoff Method to Create Conversion Tables The Angoff Method is a research-based process used to establish cut scores corresponding to each level of proficiency A cut-score is the lowest possible raw score that will result in a particular proficiency level A cut-score is used to establish the range of raw scores at each proficiency level

Conversion Tables Establish Cut-Scores Level 2 Problems – Level 2, 3 and 4 students should get these questions correct. Question Number Level 2Level 3Level

Conversion Tables Establish Cut-Scores Level 3 Problems – Level 3 and 4 students should get these questions correct. Question Number Level 2Level 3Level 4 1 – Total

Conversion Tables Establish Cut-Scores Level 4 Problems – Level 4 students should get these questions correct. Question Number Level 2Level 3Level Total71619

Conversion Tables: Establish Cut-Scores Question NumberLevel 2Level 3Level Total Add up the total number of points you would expect a Level 2, Level 3, and Level 4 student to receive.

Conversion Tables Establish Cut-Scores for the Half Points Cut scores represent the lowest score at a specific level To achieve a score of 1.5, 2.5 or 3.5 students must demonstrate at least half of the learning of the next level Cut scores for half points are the nearest whole number that is at least half way between the cut- scores for Levels 2, 3, and 4

The Angoff Method Determine Cut-Scores for Levels 1.5, 2.5 and

The Angoff Method Determine Cut-Scores for Levels 1.5, 2.5 and 3.5 Fill in the raw score range for each Proficiency Level. The conversion table is now complete

Conversion Table Your Turn Create the Conversion Table for the assessment you took at the beginning of the class. ANSWER:

Best Practices in Assessment 1.Stay focused on standards and proficiency scales to level assessments. Leveled assessments by design assess the standard. 2.When modifying an existing assessment, follow the SEA Method for developing a leveled assessment tied to a proficiency scale. 3.To assess student learning and achievement of the standard, make sure you have the bulk of the questions at Level 3 (the standard), with some questions at Level 2 and some questions at Level 4. Leveled assessments by design assess a full range of levels of proficiency on a standard. 4.To convert raw scores into cut scores on scoring guides, use the Angoff Method.

Resources This Excel spreadsheet that will help you create a conversion table using cut scores. If you enter the number of possible points for each level (2, 3, and 4) it will calculate the conversion table for you! ***This spreadsheet is on the RMS portal under Standards-Based Grading