Composite Index Scores (CIS) Understanding Accountability for Strategic Goal Setting August 24, 2015 Andrew Milligan | RIDE Office of Transformation.

Slides:



Advertisements
Similar presentations
Presented to the State Board of Education August 22, 2012 Jonathan Wiens, PhD Office of Assessment and Information Services Oregon Department of Education.
Advertisements

AMOs 101 Understanding Annual Measurable Objectives Office of Educational Accountability Wisconsin Department of Public Instruction November 2012.
Franklin Public Schools MCAS Presentation November 27, 2012 Joyce Edwards Director of Instructional Services.
Monthly Conference Call With Superintendents and Charter School Administrators.
+ Utah Comprehensive Accountability System (UCAS) 1 Hal Sanderson, Ph.D. Research and Assessment August 21,
Kentucky’s School Report Card and Spreadsheets
Accountability data overview August Topics  Changes to 2014 accountability reporting  Overview of accountability measures  Progress & Performance.
Rhode Island Accountability Process Revisions for School Years 2015 and 2016 A Presentation to the Accountability 3.0 Statewide Webinar March 27, 2015.
Subtitle Title I Federal School Accountability Office of School Improvement and Turnaround Indiana Department of Education March 2012.
New DC OSSE ESEA Accountability. DC OSSE ESEA Accountability Classification Overview I. DC OSSE Accountability System II. Classification of Schools III.
Nevada Transitioning from measuring status and reporting AYP, to measuring growth and reporting on School Performance.
2015 Goals and Targets for State Accountability Date: 10/01/2014 Presenter: Carla Stevens Assistant Superintendent, Research and Accountability.
Minnesota’s New Accountability System “Leading for educational excellence and equity. Every day for every one.”
School Performance Measure Calculations SY Office of Achievement and Accountability.
Understanding Wisconsin’s New School Report Card.
School Progress Index 2012 Results Mary Gable- Assistant State Superintendent Division of Academic Policy Carolyn Wood - Assistant State Superintendent.
Dr. Michael Flicek Education Consultant October 8, 2013 Wyoming School Performance Rating Model Report to: Wyoming State Board of Education.
Review Planning Faribault Public Schools DATA DAY.
UNDERSTANDING HOW THE RANKING IS CALCULATED Top-to-Bottom (TTB) Ranking
School Performance Index School Performance Index (SPI): A Comprehensive Measurement System for All Schools Student Achievement (e.g. PSSA) Student Progress.
Information on Focus Schools Released/Retained Fall 2015.
MARSHALL PUBLIC SCHOOLS STATE ACCOUNTABILITY RESULTS Multiple Measurement Rating (MMR) – Initial Designation.
NECAP Ramp-Up Programs Math Grade 4  4 /5 Students Improved 2/5 Improved 2 levels 2/5 Improved 1 level 1/5 No Change Reading Grade 4  8/9 Students Improved.
Measuring Charter Quality Eric Paisner, NAPCS Anna Nicotera, NAPCS Lyria Boast, Public Impact.
Department of Research and Evaluation Santa Ana Unified School District 2011 CST API and AYP Elementary Presentation Version: Elementary.
1 Paul Tuss, Ph.D., Program Manager Sacramento Co. Office of Education August 17, 2009 California’s Integrated Accountability System.
Accelerating All Schools Toward Greatness The New Rhode Island Accountability System.
S TATE A CCOUNTABILITY S YSTEM AND N EW S CHOOL R EPORT C ARDS 1.
Adequate Yearly Progress (AYP) and Accountability Status Determinations.
School & district accountability reporting Title I Technical Assistance & Networking Session October 17, 2013.
School Performance Framework Sponsored by The Colorado Department of Education Summer 2010 Version 1.3.
ESEA Flexibility: School Progress Index Overview Maryland Accountability Program Presentation 3 of 8.
Santa Ana Unified School District 2011 CST Enter School Name Version: Intermediate.
NH Commissioner’s Task Force Meeting August 10, 2010 NH DOE 1 Commissioner's Force Meeting: August 10, 2010.
Public School Accountability System. Background One year ago One year ago –100 percent proficiency required in –AMOs set to increase 7-12 points.
School Accountability No Child Left Behind & Arizona Learns.
Capacity Development and School Reform Accountability The School District Of Palm Beach County Adequate Yearly Progress, Differentiated Accountability.
Assigns one of three ratings:  Met Standard – indicates campus/district met the targets in all required indexes. All campuses must meet Index 1 or 2.
ESEA Federal Accountability System Overview 1. Federal Accountability System Adequate Yearly Progress – AYP defined by the Elementary and Secondary Education.
1 Getting Up to Speed on Value-Added - An Accountability Perspective Presentation by the Ohio Department of Education.
1 Accountability Systems.  Do RFEPs count in the EL subgroup for API?  How many “points” is a proficient score worth?  Does a passing score on the.
No Child Left Behind California’s Definition of Adequate Yearly Progress (AYP) July 2003.
AMOs 101 Understanding Annual Measurable Objectives Office of Educational Accountability Wisconsin Department of Public Instruction November 2012.
October 24, 2012 Jonathan Wiens, PhD Accountability and Reporting Oregon Department of Education.
703 KAR 5:225 Next-Generation Learners Accountability System Office of Assessment and Accountability Division of Support & Research KDE:OAA:DSR:cw,ko.
Kentucky’s New Assessment and Accountability System What to Expect for the First Release of Data.
Combining Multiple Measures What are the indicators/ components? What are the priority outcomes? What are the performance expectations? How can we evaluate.
Novice Reduction & Non-Duplicated Gap Group
Public School Accountability System. Uses multiple indicators for broad picture of overall performance Uses multiple indicators for broad picture of overall.
ESEA Flexibility Designation Overview Index Targets and Proficiency-based Annual Measureable Objectives (AMOs)
Minnesota’s Proposed Accountability System “Leading for educational excellence and equity. Every day for every one.”
MCAS Progress and Performance Index Report 2013 Cohasset Public Schools.
Globalization. Innovation. Graduation.  Transition to Five Achievement Levels  School Performance Grades (A–F)  EVAAS as a Tool NC READY ACCOUNTABILITY.
Accountability Overview Presented by Jennifer Stafford Office of Assessment and Accountability Division of Support & Research KDE:OAA:DSR:pp: 12/11/2015.
Legislative Requirement 2013
Accountability & Assistance Advisory Council Meeting
State of Wisconsin School Report Cards Fall 2014 Results
Academic Performance Index (API) and AYP
Washington’s ESSA Consolidated Plan Implementation 101
Massachusetts’ Next-Generation Accountability System
Accountability Progress Report September 16, 2010
Milton Public Schools 2013 Accountability Status
Specifications Used for School Identification Under ESSA in
Campus Comparison Groups and Distinction Designations
Kentucky’s New Assessment and Accountability System
School Performance Measure Calculations SY
WAO Elementary School and the New Accountability System
Spencer County Public Schools
2019 Report Card Update Marianne Mottley Report Card Project Director
State of Wisconsin School Report Cards Fall 2014 Results
Presentation transcript:

Composite Index Scores (CIS) Understanding Accountability for Strategic Goal Setting August 24, 2015 Andrew Milligan | RIDE Office of Transformation

Objectives Firm up a technical understanding of the current Composite Index Score (CIS) and how it informs school improvement planning in general, and goal setting in particular Understand the impact of the PARCC transition on the CIS and planning for the future

Agenda 1.(Re)-Introduction to the CIS – 5 min 2.Deeper Dive a)Proficiency & work-time – 12 min b)Gaps & work-time – 12 min c)Growth & work-time – 8 min d)Graduation– 8 min 3.Questions – 15 min

Exit Criteria Priority: – Achieve 50+ points on CIS for 3 consecutive years – Or meet 80% of AMOs for 3 consecutive years Focus – Achieve 50+ points of CIS for 2 consecutive years – Or meet 80% of AMOs for 2 consecutive years (50 is equivalent to a classification of “Typical”)

What You Probably Already Know All schools will be assigned a composite index score between 20 and 100. MeasureDefinition Elementary / Middle Schools High Schools Absolute Percent Proficient How many students have attained proficiency or better? 30 points Progress To 2017 Target Is the school approaching its 2017 targets? 10 points Achievement Gaps Is the school serving all students, including those with disabilities and English Learners? 30 points Percent of Students at Distinction Level How many students have attained distinction? 5 points Growth Are all students making progress? 25 pointsn/a HS Graduation Rates Is the school reaching its graduation-rate goals? n/a 20 points High School Scaled Score Is the school improving annually? n/a 5 TOTAL 100 possible points

What about PARCC? The transition to PARCC this year will have minor changes to the CIS for : MeasureNECAPPARCC (E/M)PARCC (H) Absolute Percent Proficient30 points33.33 points35.3 Progress To 2017 Target10 points0 points Achievement Gaps30 points33.33 points35.3 Percent of Students at Distinction Level 5 points5.56 points5.89 Growth (E/M)25 points27.78 pointsn/a HS Graduation Rates (H) 20n/a23.53 High School Scaled Score (H) 5 n/a TOTAL 100 possible points

A Closer Look 85 of the 100 points for elementary and middle schools and 85 for high schools come from these three categories: – Proficiency (30) – Gaps (30) – Growth (25) OR Graduation (20)

A Closer Look Cont. Three of these components have subcomponents based on subjects… – Reading – Math …and one or more student subgroups – All students – Reference students – Minority/SES – IEP/ELL

Lets Try The Math For Proficiency, we have two subjects (reading and math) each examined for three subgroups (ALL, Min/SES, and IEP/ELL) for a total of 6 subcomponents Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof

Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof Each subcomponent is then converted into a “subscore” using a score-specific table. Each one looks a little different but here’s the table for “Proficiency”

Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof

Elementary School SubjectReadingMath Group All Students Minority/PovertyProgram All Students Minority/PovertyProgram % Prof We next find the average of these subscores: 2.67 Then, divide by 5 (the maximum for each subscore) = = 5.53 And finally, multiply this fraction by the total points for Progress, which was X 30 points = 16 points for progress

Work time (12 minutes) Try re-creating your schools “Proficiency” component score using this procedure: 1.Find each subscore using the cut score table provided 2.Average the subscores 3.Divide the average by 5 to get a fraction 4.Multiple your fraction by the max points

Lets Try The Math For Gaps, we have two subjects (reading and math) each examined for two subgroups (Min/SES and IEP/ELL) for a total of 4 subcomponents Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL Difference from Reference Difference from Reference

Lets Try The Math Each subcomponent is then converted into a subscore by looking up the differences, or gaps on this cut score table for “Gaps”: Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL Difference from Reference Difference from Reference

Lets Try The Math Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL Difference from Reference Difference from Reference

We next find the average of these subscores: 3.25 Then, divide by 5 (the maximum for each subscore) = = 5.65 And finally, multiply this fraction by the total points for Gaps, which was X 30 points = 19.5 points for gaps Reading Reference Reading Min/SES Reading IEP/ELL Math Reference Math Min/SES Math IEP/ELL Difference from Reference Difference from Reference

Work time (12 minutes) Try re-creating your schools “Gaps” component score using this procedure: 1.Find each subscore using the cut score table provided 2.Average the subscores 3.Divide by 5 to get a fraction 4.Multiple your fraction by the max points

Lets Try The Math For Growth, we have one subject (SGPs for reading and math are combined) each examined for threesubgroups (All students, Min/SES and IEP/ELL) for a total of 3 subcomponents AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP: 29.5

Lets Try The Math Each subcomponent is then converted into a subscore by looking up the median SGPs, this cut score table for “Growth”: AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP: 29.5

Lets Try The Math AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP:

We next find the average of these subscores: 3 Then, divide by 5 (the maximum for each subscore) = 3 3= 5.6 And finally, multiply this fraction by the total points for growth, which was 30.6 X 25 points = 15 points for growth AllMin/SESIEP/ELL Median SGP: 67.2Median SGP: 51.2Median SGP:

Work time (8 minutes) Try re-creating your schools “Growth” component score using this procedure: 1.Find each subscore* using the cut score table provided 2.Average the subscores 3.Divide by 5 to get a fraction 4.Multiple your fraction by the max points *Note: Two of our subcomponents are not reported publicly, but you can find more detailed information on different student groups in the growth model visualization tool. I have provided you with your schools subscore for this exercise.

Lets Try The Math For Graduation, we have one “subject” and one student group, so we only have one subcomponent. However, graduation uses either the 4-year rate or the composite index rate, whichever is higher We also need to know a schools grad. rate target and the state average All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 School Target: 66.2 ± 5.6 Statewide Average: 80

Lets Try The Math Grad. rate points are determined using a subscore and an additional bonus point. To determine the subscore use the table below. To determine the bonus point, simply see whether the grad. rate meet the school target or was higher than the state average? All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 School Target: 66.2 ± 5.6 Statewide Average: 80

Lets Try The Math All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 Statewide Average: 80 School Target: 66.2 ±

Lets Try The Math All Students (2013) 4 Year Grad. Rate: 73.8 Composite Grad. Rate: 76.0 Statewide Average: 80 School Target: 66.2 ± Divide the subscore by 6 (instead of 5!!) 4 6 =.66 Multiply this percentage by X 20 = 13.33

Work time (8 minutes) Try re-creating your schools “Graduation” component score using this procedure: 1.Determine whether to use the 4 year or composite rate, whichever is higher 2.Using the cut score table provided find your subscore 3.Determine if either the rate is higher than the target or the state average, if so add a bonus point to your subscore 4.Divide the subscore by 6 5.Multiple your fraction by the max points (20)

Questions?